DESCRIPTION 

CAMERA TERMINAL AND IMAGING ZONE ADJUSTING APPARATUS 

5 

Technical Field 

[0001] 

The present invention relates to a camera terminal of an 
10 imaging system for obtaining image information of real space using 
multiple camera terminals and an apparatus for adjusting an 
imaging zone with multiple camera terminals. 



V 

t 



Background Art 

15 

[0002] 

Recently, research and development efforts have been made 
on an apparatus using multiple cameras mainly used for surveillance. 
For usage purposes, the apparatus must meet two requirements for 
20 an imaging target zone comprising a surveillance target zone: 

first, to provide constant surveillance of the imaging target 
zone with no blind spots and to detect a target within the zone, and 

second, the requirement is to obtain detailed information on 
the detection target present within the imaging target zone. 

25 

[0003] 

The conventional apparatus using multiple cameras 
self-adjusts the imaging zone of each camera to meet the two 
requirements. Such conventional apparatuses using multiple 
30 cameras are represented in Patent References 1 and 2. 
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ATTACHMENT B 



1 



V 



[0004] 

First, the conventional apparatus referred to in Patent 
Reference 1 is described. FIG. 1 illustrates the apparatus of the 
5 first conventional art described in Patent Reference 1 that 

self-adjusts camera imaging zones. With the detection camera 
apparatus 10010 of FIG. 1, a camera 10011 and a reflection mirror 
10012 capture a detection target image throughout an extensive 
imaging zone, a moving object extractor 10013 extracts the 

10 detection target in the captured image, and a positional information 
extractor 10014 extracts the positional information of the detection 
target. Thus, the detection camera apparatus 10010 obtains the 
positional information of the detection target throughout the 
extensive imaging zone. With evaluation camera apparatus 10020, 

is a camera controller 10022 controls the rotation and depression 
angles and zoom rate of a camera 10021 based on the positional 
information of the detection target, and the evaluation camera 
apparatus 10020 captures an enlarged image of the detection target. 
Thus, the evaluation camera apparatus 10020 obtains detailed 

20 information of the detection target. 

[0005] 

FIG. 2 is a drawing showing the imaging zones of the 
detection camera apparatus 10010 and evaluation camera 

25 apparatus 10020. In the figure, the black circles indicate the 
positions where the detection camera apparatuses 10110 
comprising fixed cameras are installed, of which the circles or 
hexagons indicate the imaging zones. When, as shown in the figure, 
the detection camera apparatuses 10110 are artificially installed on 

30 a regular basis, the imaging target zone or surveillance target zone 
can be constantly detected with no blind spots. 
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[0006] 

A conventional apparatus referred to in Patent Reference 2 is 
described hereafter. FIG. 3 illustrates the second conventional 
apparatus described in Patent Reference 2 that self-adjusts the 
5 camera imaging zones. In FIG. 3, a moving object detection 

camera 10211 intended to capture an image of a detection target 
throughout an extensive imaging zone changes one's own imaging 
zone using an orientation control means 10212, and a surveillance 
camera 10221 intended to capture an enlarged image of the 

10 detection target changes one's own imaging zone using an 
orientation control means 10222. The imaging zone of each 
camera is determined based on information previously stored in a 
camera field angle memory means 10231 and a camera field angle 
memory means 10232 using the position of a detection target 

15 extracted in the image captured by the moving object detection 
camera 10211 and the imaging zone of each camera in an image 
processing apparatus 10240. 

[0007] 

20 How the imaging zone of each camera is determined is further 

described next. FIGS. 4, 5, and 6 are illustrations explaining how 
the imaging zone of each camera is determined in the second 
conventional art, illustrating images captured by the moving object 
detection camera 10211 and dividing them into several block images. 

25 First, the imaging zone of the moving object detection camera 

10211 is determined as follows. When a detection target is present 
in the shaded blocks of FIG. 4, the orientation of the moving object 
detection camera 10211 is changed in the direction of the arrows in 
each of the blocks of FIG. 54 corresponding to FIG. 4, respectively, 

30 thereby changing the imaging zone of the camera. The imaging 
zone of the moving object detection camera 10211 corresponding to 
each block position is manually pre-determined and the information 
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is pre-set in the camera field angle memory means 10231. Then, 
the imaging zone of the surveillance camera 10221 is determined as 
follows. When a detection target is present in the block position 
shown in FIG. 6, the orientation of the surveillance camera 10221 is 
5 changed to have the imaging zone indicated by the broken lines, 
thereby changing the imaging zone of the camera. The imaging 
zone of the surveillance camera 10221 corresponding to each block 
position is manually pre-determined and the information is pre-set 
in the camera field angle memory means 10232. 

10 

[0008] 

Characteristics of the imaging zone self-adjustment of the 
conventional apparatus using multiple cameras are summarized 
hereafter. First, each camera has a fixed, pre-determined role. 

15 Namely, it is the detection camera apparatus 10010 in the 

conventional apparatus referred to in Patent Reference 1 and the 
moving object detection camera 10211 in the conventional 
apparatus referred to in Patent Reference 2 that plays the role of 
detecting a detection target throughout an extensive imaging zone 

20 and it is the evaluation camera apparatus 10020 in the conventional 
apparatus referred to in Patent Reference 1 and the surveillance 
camera 10211 in the conventional apparatus referred to in Patent 
Reference 2 that plays the role of obtaining detailed information of 
the detection target, such as an enlarged image of the detection 

25 target. Thus, a camera playing one role achieves the first 

requirement and a camera playing the other role achieves the 
second requirement (the first characteristic of the conventional art). 

[0009] 

30 In the conventional apparatus referred to in Patent Reference 

2, for example, the imaging zone of the moving object detection 
camera 10211 is changed to the detection zone shifted to the top left 
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shown as the top left block of FIG. 54 according to the change in the 
situation, in that a detection target is present in the top left block of 
the FIG. 4. Thus, the imaging zone of each camera is determined 
and adjusted based on information in the form of a table containing 
5 situational changes predicted and manually created and imaging 
zones corresponding thereto on a one-to-one basis (the second 
characteristic of the conventional art). 

[0010] 

10 The conventional apparatus referred to in Patent Reference 1 

uses manually pre-placed fixed cameras on a regular basis in order 
to achieve the first requirement (the third characteristic of the 
conventional art). 

15 [0011] 

The self-adjustment of the imaging zone of the conventional 
apparatus using multiple cameras is described above. 
Self-adjustment of the imaging zone of the conventional apparatus 
using a single camera is described hereafter. An apparatus using a 
20 single camera and self-adjustment the imaging zone of the camera 
is described in Patent Reference 3. Patent Reference 3 discloses 
two techniques, known as "auto-scanning" and "auto-panning" as a 
means for self-adjustment the imaging zone of a camera. 

25 [0012] 

First, the "auto-scanning" technique is described. FIG. 8 is a 
drawing explaining the "auto-scanning" technique according to the 
third conventional art. The "auto-scanning" technique allows a 
camera 10701 to sequentially automatically image multiple imaging 
30 zones from a first imaging zone 10711 to an n-th imaging zone 
1071N shown in the figure. Imaging zone information of the first 
imaging zone 10711 to the n-th imaging zone 1071N is pre-recorded 
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in a recording means 10703. This technique is realized by an 
orientation control means 10702 controlling the orientation of the 
camera 10701 based on the information recoded in the recording 
means 10703 so as to sequentially change the imaging zone of the 
5 camera 10701 from the first imaging zone 10711 to the n-th imaging 
zone 1071N. 

[0013] 

The "auto-panning" technique is described hereafter. FIG. 9 
10 is a drawing explaining the "auto-panning" technique. The 

"auto-panning" technique allows a camera 10801 to automatically 
and repeatedly pan from side to side between a first panning angle 

10811 and a second panning angle 10812 shown in the figure so as 
to self-adjust the imaging zone of the camera 10801. Though not 

15 shown in FIG. 9, the technique is realized by mechanical switches 
provided for the first panning angle 1081 1 and second panning angle 

10812 and confirm that the camera 10801 is oriented at either 
panning angle so that an orientation control means 10802 controls 
the orientation of the camera. 

20 

[0014] 

Characteristics of the self-adjustment of the imaging zone of 
the conventional apparatus using a single camera are summarized 
hereafter. In the conventional apparatus referred to in Patent 

25 Reference 3, for example, the imaging zone of the camera 10701 is 
changed based on the imaging zone information of the first imaging 
zone 10711 to the n-th imaging zone 1071N recorded in the recoding 
means 10703. Similar to the self-adjustment of the imaging zone 
of the apparatus using multiple cameras, the imaging zone of the 

30 camera is determined and adjusted based on information in the form 
of a table containing imaging zones manually predicted and created 
although they do not correspond to situational changes on a 
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one-to-one basis (the second characteristic of the conventional art). 
Patent Reference 1: Japanese Patent Publication No. 3043925 (FIGS. 
1 and 6) 

Patent Reference 2: Japanese Patent Publication No. 3180730 (FIGS. 
5 1 and 7 to 9) 

Patent Reference 3: Japanese Laid-Open Patent Application No. 
H01-288696 

Disclosure of Invention 
10 Problems that Invention is to Solve 

[0015] 

However, in the conventional apparatuses described above, 
the imaging zone of each camera is determined and adjusted based 

is on information in the form of a table containing situational changes 
manually predicted and set up and imaging zones corresponding 
thereto on a one-to-one basis (the above second characteristic of 
the conventional art). Therefore, information in the form of a table 
containing situational changes and imaging zones corresponding 

20 thereto on a one-to-one basis should be manually predicted and 
created one by one for each camera. 

[0016] 

The information depends on the position and size of the 
25 imaging zone, individually predicted situational changes, locations 
and the number of cameras. Each time a change occurs in the 
elements, the information should be individually recreated one by 
one. The work becomes complex as the number of cameras 
increase and its cost and workload becomes enormous. It is 
30 common that a building surveillance system will use over ten 
cameras. 
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[0017] 

The conventional apparatuses meet the first requirement by 
manually positioning fixed cameras on a regular basis (the above 
third characteristic of the conventional art). However, even if a 
5 single camera failure occurs, the apparatus fails to achieve the first 
requirement. 

[0018] 

For example, as shown in FIG. 7, an increased number of 
10 detection camera apparatuses 10010 can be used to cover the 
detection target zone with no blind spots regardless of a single 
camera failure. However, this is no doubt inefficient. 

[0019] 

It is an objective of the present invention to resolve the 
conventional art problems indicated above, and to provide an 
imaging zone adjusting apparatus that eliminates the necessity of 
manually predicting situational changes and creating a table and 
allows the imaging target zone to be imaged with no blind spots, 
even if some of the multiple cameras are unserviceable and a 
camera terminal constitutes the imaging zone adjusting apparatus. 

Means to Solve the Problems 

25 [0020] 

In order to achieve the above purpose, the camera terminal 
according to the present invention is a camera terminal constituting 
an imaging zone adjusting apparatus that adjusts an imaging zone 
using multiple camera terminals, including: a camera that images a 
30 hypothetical imaging zone that is a hypothetical imaging zone 
obtained by changing the position of an imaging zone within a 
specific zone in a specific period of time; an adjusting unit that 
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adjusts the position of the hypothetical imaging zone by controlling 
the camera; and a communication unit that sends/receives 
hypothetical imaging zone information indicating the hypothetical 
imaging zone, wherein the adjusting unit adjusts the position of the 
5 hypothetical imaging zone to which the camera terminal belongs 
based on the hypothetical imaging zone to which the camera 
terminal belongs provided with the adjusting unit and the 
hypothetical imaging zones of the other camera terminals indicated 
by the hypothetical imaging zone information received by the 

10 communication unit so that a combined zone of the hypothetical 
imaging zones of the multiple camera terminals completely covers a 
specific imaging target zone. Thus, multiple camera terminals 
cooperate to cover the imaging target zone with multiple 
hypothetical imaging zones with no blind spots. Compared with a 

15 method of covering an imaging target zone with real imaging zones, 
using hypothetical imaging zones allows any imaging zone to be 
assigned to a single camera terminal. Therefore, an imaging zone 
adjusting apparatus can be realized for imaging target zones of 
different sizes and shapes. 

20 

[0021] 

"The hypothetical imaging zone" in the Claims corresponds, 
for example, to a cycle Tcycle imaging zone in the embodiments, 
which comprises a combined zone of imaging zones continuously 

25 imaged by a single camera terminal through a scanning operation 
such as panning and tilting in a specific period of Tcycle time. 
Similarly, "the hypothetical detection zone" corresponds, for 
example, to a cycle T C ycle detection zone in the embodiments, 
comprising a combined zone of detection zones (detection spaces) 

30 continuously detected by a single sensor terminal through a 

scanning operation such as orientation in detection directions in a 
specific period of time Tcycle- 
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[0022] 

Here, it is preferable that the camera comprises a unit that 
changes the cycle, the adjusting unit adjusts the position of the 
5 hypothetical imaging zone to which the camera terminal belongs 
based on the hypothetical imaging zone to which the camera 
terminal belongs and the hypothetical imaging zones of other 
camera terminals so that a combined zone of the hypothetical 
imaging zones of the multiple camera terminals completely covers 

10 the imaging target zone and adjusts the position and cycle of the 
hypothetical imaging zone to which the camera terminal belongs so 
that the cycle of the hypothetical imaging zone to which the camera 
terminal belongs and the cycle of a hypothetical imaging zone 
adjacent thereto are nearly equal, wherein the adjusting unit 

15 adjusts the position of the hypothetical imaging zone to which the 
camera terminal belongs based on the hypothetical imaging zone to 
which the camera terminal belongs and the hypothetical imaging 
zones of the other camera terminals so that a combined zone of the 
hypothetical imaging zones of the multiple camera terminals 

20 completely covers a specific imaging target zone and adjusts the 
position and cycle of the hypothetical imaging zone to which the 
camera terminal belongs so that the cycle of the hypothetical 
imaging zone to which the camera terminal belongs becomes smaller, 
the adjusting unit divides an imaging target zone into zones 

25 assigned to the multiple camera terminals and adjusts the position 
and field angles of the hypothetical imaging zone to which the 
camera terminal belongs so that the hypothetical imaging zones of 
the multiple camera terminals cover the divided zones, respectively, 
the adjusting unit adjusts the aspect ratio of the hypothetical 

30 imaging zone, the adjusting unit adjusts the position of the 

hypothetical imaging zone to which the camera terminal belongs 
based on the hypothetical imaging zone to which the camera 
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terminal belongs and the hypothetical imaging zones of other 
camera terminals so that a combined zone of the hypothetical 
imaging zones of the multiple camera terminals completely covers a 
specific imaging target zone and adjusts the position and aspect 
5 ratio of the hypothetical imaging zone to which the camera terminal 
belongs so that the aspect ratio of the hypothetical imaging zone of 
one's own camera terminal is a specific target quantity. 

[0023] 

10 Further, it is preferable that the target quantity of the aspect 

ratio is the aspect ratio of an imaging zone determined by the 
imaging zone position and camera installation position. 

[0024] 

15 The present invention can be realized as an imaging zone 

adjusting apparatus (imaging system) that adjusts an imaging zone 
using the described multiple camera terminals, having not only a 
distributed control structure in which the camera terminals 
constituting the imaging zone adjusting apparatus each have an 

20 adjusting unit, but also a central control structure in which a 

common adjusting unit adjusts the detection zones of all common 
terminals, as an imaging zone adjustment method, and as a 
program to execute the method. Further, the present invention can 
be realized as a sensor terminal that adjusts the detection zone of a 

25 sensor that can detect physical quantities such as a micro-motion 
sensor in place of an imaging zone comprising a zone imaged by a 
camera or as a detection zone adjusting apparatus (detection 
system) that adjusts a detection zone using the described multiple 
sensor terminals. Needless to say, the program according to the 

30 present invention can be distributed by recording media such as 
computer readable CD-ROMs and transmission media such as the 
Internet. 
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Effects of the Invention 

[0025] 

The camera terminal and imaging zone adjusting apparatus 
according to the present invention self-adjusts the cycle T imaging 
zones of the cameras of the camera terminals so that a combined 
zone of the cycle T imaging zones of the cameras of the camera 
terminals completely covers a specific imaging target zone, thereby 
eliminating the necessity of manually predicting and creating cycle T 
imaging zone information corresponding to situational changes for 
each camera as in the conventional art and allowing a specific 
imaging target zone to be efficiently covered by the remaining 
cameras with no blind spots even if some of multiple cameras are 
unserviceable. 

[0026] 

Therefore, the present invention guarantees that any space 
can be imaged with no blind spots and has a particularly high 
20 practical value as a surveillance system for suspicious individuals in 
schools and buildings. 

Brief Description of Drawings 

[0027] 

25 

[FIG. 1] 

FIG. 1 is a block diagram showing the structure of a first 
conventional art. 

30 [FIG. 2] 

FIG. 2 is a drawing explaining the camera field of vision of the 
first conventional art. 
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[FIG. 3] 

FIG. 3 is a block diagram showing the structure of a second 
conventional art. 
[FIG. 4] 

FIG. 4 is a drawing explaining the operation of the second 
conventional art. 
[FIG. 5] 

FIG. 5 is a drawing explaining the operation of the second 
conventional art. 

[FIG. 6] 

FIG. 6 is a drawing explaining the operation of the second 
conventional art. 

15 

[FIG. 7] 

FIG. 7 is a drawing explaining the operation of the second 
conventional art. 

20 [FIG. 8] 

FIG. 8 is a drawing explaining the operation of a third 
conventional art. 

[FIG. 9] 

25 FIG. 9 is a drawing explaining the operation of the third 

conventional art. 

[FIG. 10] 

FIG. 10 is a drawing explaining the imaging zone of a camera. 

30 

[FIG. 11] 

FIG. 11 is a drawing explaining the relationship between a 
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detection target and a cycle T C ycle imaging zone. 
[FIG. 12] 

FIG. 12 is a drawing explaining the relationship between the 
5 size of a cycle T C ycle imaging zone and various parameters of a 
camera. 

[FIG. 13] 

FIG. 13 is a drawing explaining the relationship between the 
10 size of a cycle Tcycle imaging zone and various parameters of a 
camera. 

[FIG. 14] 

FIG. 14 is a drawing explaining the imaging zone position of a 
15 camera. 

[FIG. 15] 

FIG. 15 is a drawing explaining the imaging process of a cycle 
Tcycle imaging zone. 

20 

[FIG. 16] 

FIG. 16 is a drawing explaining the imaging process of a cycle 
Tcycle imaging zone. 

25 [FIG. 17] 

FIG. 17 is a flowchart showing the procedure of the imaging 
process of a cycle Tcycle imaging zone. 

[FIG. 18] 

30 FIG. 18 is a flowchart showing the procedure of the imaging 

process of a cycle Tcycle imaging zone. 
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[FIG. 19] 

FIG. 19 is a flowchart showing the procedure of the imaging 
process of a cycle T C ycle imaging zone. 

[FIG. 20] 

FIG. 20 is a drawing explaining the shape of an imaging zone. 
[FIG. 21] 

FIG. 21 is a drawing explaining the shape of an imaging zone. 
[FIG. 22] 

FIG. 22 is a drawing explaining the zone determination 
process. 

[FIG. 23] 

FIG. 23 is a drawing explaining how to determine in which 
direction another imaging zone is present in relation to the current 
imaging zone. 

[FIG. 24] 

FIG. 24 is a drawing explaining the zone dividing process. 
[FIG. 25] 

FIG. 25 is a drawing explaining the zone dividing process. 
[FIG. 26] 

FIG. 26 is a block diagram showing the structure of an 
imaging zone adjusting apparatus in Embodiment 1 of the present 
invention. 

[FIG. 27] 
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FIG. 27 is a block diagram showing the structure of a camera 
terminal in Embodiment 1 of the present invention. 

[FIG. 28] 

5 FIG. 28 is a block diagram showing the structure of the 

operation terminal in Embodiment 1 of the present invention. 

[FIG. 29] 

FIG. 29 is a flowchart of the procedure performed by an 
io adjustor A in Embodiment 1 of the present invention. 

[FIG. 30] 

FIG. 30 is a drawing explaining a function FA () in 
Embodiment 1 of the present invention. 

15 

[FIG. 31] 

FIG. 31 is a drawing explaining a function FA () in 
Embodiment 1 of the present invention. 

20 [FIG. 32] 

FIG. 32 is a block diagram showing the structure of a camera 
terminal in Embodiment 2 of the present invention. 

[FIG. 33] 

25 FIG. 33 is a flowchart of the procedure performed by the field 

angle adjustor A in Embodiment 2 of the present invention. 

[FIG. 34] 

FIG. 34 is a block diagram showing the structure of a camera 
30 terminal in Embodiment 3 of the present invention. 

[FIG. 35] 
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FIG. 35 is a flowchart of the procedure performed by the field 
angle adjustor B in Embodiment 3 of the present invention. 

[FIG. 36] 

5 FIG. 36 is a drawing explaining the imaging efficiency in 

Embodiment 4 of the present invention. 

[FIG. 37] 

FIG. 37 is a drawing explaining the imaging efficiency in 
10 Embodiment 4 of the present invention. 

[FIG. 38] 

FIG. 38 is a block diagram showing the structure of a camera 
terminal in Embodiment 4 of the present invention. 

15 

[FIG. 39] 

FIG. 39 is a flowchart of the procedure performed by an 
adjustor B in Embodiment 4 of the present invention. 

20 [FIG. 40] 

FIG. 40 is a block diagram showing the structure of an 
imaging zone adjusting apparatus in Embodiment 5 of the present 
invention. 

25 [FIG. 41] 

FIG. 41 is a drawing showing the detailed view points of the 
cycle Tcycle imaging zones on a real space plane of the imaging zone 
adjusting apparatus in Embodiment 5 of the present invention. 

30 [FIG. 42] 

FIG. 42 is a block diagram showing the structure of a camera 
terminal in Embodiment 5 of the present invention. 
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[FIG. 43] 

FIG. 43 is a flowchart of the procedure performed by an 
adjustor B in Embodiment 5 of the present invention. 

[FIG. 44] 

FIG. 44 is a block diagram showing the structure of an 
imaging zone adjusting apparatus in Embodiment 6 of the present 
invention. 

[FIG. 45] 

FIG. 45 is a flowchart of the procedure performed by an 
adjustor A in Embodiment 7 of the present invention. 

15 [FIG. 46] 

FIG. 46 is a flowchart of the procedure performed by the field 
angle adjustor A in Embodiment 7 of the present invention. 

[FIG. 47] 

20 FIG. 47 is a flowchart of the procedure performed by the field 

angle adjustor B in Embodiment 7 of the present invention. 

[FIG. 48] 

FIG. 48 is a flowchart of the procedure performed by adjustor 
25 C in Embodiment 7 of the present invention. 

[FIG. 49] 

FIG. 49 is a flowchart of the procedure performed by adjustor 
B in Embodiment 7 of the present invention. 

30 

[FIG. 50] 

FIG. 50 is a block diagram showing the structure of an 
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imaging zone adjusting apparatus in Embodiment 7 of the present 
invention. 

[FIG. 51] 

5 FIG. 51 is a block diagram showing the structure of an 

imaging zone adjusting apparatus in Embodiment 7 of the present 
invention. 

[FIG. 52] 

10 FIG. 52 is a drawing showing an exemplary image displayed 

by the display unit of the imaging zone adjusting apparatus in 
Embodiment 7 of the present invention. 

[FIG. 53] 

15 FIG. 53 is a drawing explaining partial scanning. 

[FIG. 54] 

FIG. 54 is a drawing showing an exemplary image displayed 
by the display unit of the imaging zone adjusting apparatus in a 
20 modified embodiment of the present invention. 

[FIG. 55] 

FIG. 55 is a drawing explaining an embodiment where the 
present invention is applied to microphones. 

25 

[FIG. 56] 

FIG. 56 is a block diagram showing the structure of a 
surveillance system composed of movable cameras. 

30 [FIG. 57] 

FIG. 57 is a drawing showing the operation of movable 
cameras in a surveillance system. 
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[FIG. 58] 

FIG. 58 is a drawing showing how movable cameras move on 
rail tracks provided in a surveillance area. 

Numerical References 



[0028] 

101A - C camera terminal 
10 102 operation terminal 

103 network 

201 camera 

202 adjustor A 

203 communications unit 

15 204 cycle field angle adjustor A 

205 cycle field angle adjustor B 

206 adjustor B 

207 cycle field angle adjustor C 

208 adjustor C 
20 211 lens 

212 image pickup surface 

213 image processor 

214 orientation controller 

215 cycle imaging controller 
25 301 input 

302 memory 

2005 image merger 

2006 display 

2007 instruction 

30 
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Best Mode for Carrying Out the Invention 

[0029] 

Embodiments of the present invention are described in detail 
5 hereafter with reference to the drawings. Several terms and basic 
matters are explained before the embodiments are described. 

[0030] 

(Camera imaging zone) 
10 First, the imaging zone of a camera is described. A camera in 

this context is a camera to chronologically obtain continuous motion 
images, for example, 30 continuous images per second, and is not a 
camera to obtain a still image of a moment, such as a still 
photograph. 

15 

[0031] 

FIG. 10 is a drawing explaining the imaging zone of a camera. 
In FIG. 10 (a) and (b), number 5001 is a camera, number 

5002 is a first imaging zone, comprising the imaging zone imaged by 
20 the camera 5001 at a where time T = 0, 2, 4, 2N, and the number 

5003 is a second imaging zone, comprising the imaging zone imaged 
by the camera 5001 at a time T = 1, 3, 5, 2N + 1 (N is a natural 
number). FIG. 10 (c) is a graphic representation showing the 
imaging zone positions of the camera 5001 at times T shown in FIG. 

25 10 (a) and (b). 

[0032] 

The term "camera imaging zone" is generally interpreted as a 
zone imaged by a camera at a moment of time. If the camera does 
30 not change its orientation at each moment, there is no problem with 
this interpretation. However, if the camera changes its orientation 
moment by moment, "the camera imaging zones" should be 
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distinguished from each other as follows. 
[0033] 

Time T imaging zone 
5 This means a zone imaged by a camera at a moment of time 

T. In this specification, the imaging zone is termed a time T 
imaging zone. In FIG. 10 (a) and (b), the first imaging zone 5002 
is a time 0 imaging zone and the second imaging zone 5003 is a time 
1 imaging zone. 

10 

[0034] • 

A time period T A -T B imaging zone or a time period T imaging 
zone, and a cycle Tcycle imaging zone 

These are examples of "hypothetical imaging zones" obtained 

15 by changing the position of an imaging zone within a specific zone in 
a specific period of time and a mean a zone imaged by a camera in 
a period of time from a time T A to a time T B . In the specification, 
the zone is termed a time period T A -T B imaging zone. Alternatively, 
a zone imaged by a camera in a period of time T from a time T A to a 

20 time T B is termed a time period T imaging zone. In particular, zones 
within an imaging zone are periodically imaged, in other words, a 
hypothetical imaging zone is repeatedly imaged by a camera in a 
specific cycle, this imaging zone is a zone imaged in a cycle Tcycle 
and termed a cycle Tcycle imaging zone. In FIG. 10 (a) and (b), the 

25 combined zone of the first imaging zone 5002 and second imaging 
zone 5003 is a time period 0-1 imaging zone or a time period 2 
imaging zone. Further, as shown in FIG. 10 (c), the first imaging 
zone 5002 and second imaging zone 5003 in the imaging zone are 
periodically imaged in 2 cycles. Therefore, the imaging zone is a 2 

30 cycle imaging zone. 

[0035] 
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The following parameters can be defined for a cycle T C ycle 
imaging zone in which zones are periodically imaged. 

[0036] • Imaging frequency F 
5 This means the imaging frequency per cycle of each zone 

within a cycle T C ycle imaging zone. According to this definition, as 
shown in FIG. 10 (c), the imaging zone where the first and second 
imaging zones overlap has an imaging frequency of 1 and the other 
imaging zones have an imaging frequency of 1/2. As shown in FIG. 
10 10 (c), the camera 5001 has different imaging frequencies F for 
different zones. The minimum imaging frequency F within the zone 
imaged by the camera 5001 is termed a minimum imaging frequency 
F M in and the maximum imaging frequency F is termed a maximum 
imaging frequency F M ax- 

15 

[0037] 

(Relationship between a detection target and a cycle Tcycle imaging 
zone) 

The relationship between a detection target detected through 
20 the imaging of a camera and a cycle T C ycle imaging zone is described 
hereafter. FIG. 11 (a) and (b) are illustrations explaining the 
relationship between a detection target and a cycle Tcycle imaging 
zone. In FIG. 11 (a) and (b), the number 5101 is a camera, the 
number 5102 is a cycle Tcycle imaging zone of each camera 5101, 
25 the number 5103 is a detection target detected through the imaging 
of each camera 5101, the number 5104 is an imaging cycle Tcycle 
maximum detection target moving zone comprising the maximum 
zone in which the detection target 5103 moves in an imaging cycle 
Tcycle. 

30 

[0038] 
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As shown in FIG. 11 (a), if the cycle T C ycle imaging zone of the 
camera 5101 covers the imaging cycle Tcycle maximum detection 
target moving zone, the imaging cycle Tcycle maximum detection 
target moving zone is imaged in an imaging cycle Tcycle, in which 
5 case the camera 5101 can image and detect the detection target 
5103 in the imaging cycle Tcycle- 

[0039] 

Alternatively, if the imaging cycle Tcycle maximum detection 
10 target moving zone is covered by the cycle Tcycle imaging zones of 
multiple cameras 5101 in place of a single camera 5101, the imaging 
cycle Tcycle maximum detection target moving zone is imaged in the 
imaging cycle T C ycle- Then, the cameras 5101 can image and detect 
the detection target 5103 in the imaging cycle Tcycle- 

15 

[0040] 

(Size of the cycle Tcycle imaging zone of a camera) 

The size of the cycle Tcycle imaging zone of a camera is 
described hereafter. FIG. 12 (a) and (b) are illustrations explaining 

20 the relationship between the size of the cycle Tcycle imaging zone 
and various camera parameters. In FIG. 12 (a), number 5201 is a 
camera. The orientation of the camera 5201 can be changed by 
panning and tilting operations and the field angles of the camera 
5201 can also be changed. The number 5202 is a time T imaging 

25 zone comprising a zone imaged by the camera 5201 at a time T, the 
number 5203 is a cycle Tcycle imaging zone comprising a zone 
imaged by the camera 5201 in a cycle Tcycle, the number 5204 is a 
horizontal field angle 0a H comprising a field angle of the camera 
5201 in the horizontal direction, the number C205 is a vertical field 

30 angle ©a v comprising a field angle of the camera 5201 in the vertical 
direction, and the number 5206 is a moving path of the time T 
imaging zone 5202. The camera 5201 changes it's own orientation 
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by panning and tilting operations over time. The position of the time 
T imaging zone 5202 is shifted along the path indicated by the time 
T imaging zone moving path 5206, whereby the cycle Tcycle imaging 
zone 5203 is imaged. Therefore, the size of the cycle Tcycle 
5 imaging zone 5203 obviously depends on the speed of panning and 
tilting operations by which the orientation of the camera 5201 is 
changed, the horizontal field angle 0a H 5204 and vertical field angle 
0a v 5205 of the camera that determine the size of the time T 
imaging zone 5202, and the length of time of the cycle Tcycle- The 
10 cycle Tcycle imaging zone 5203 is increased in size as the camera 
5201 has higher panning and tilting speeds, greater field angles, 
and a greater cycle Tcycle- 

[0041] 

15 (Field angles and panning and tilting of a camera imaging a cycle 
Tcycle imaging zone) 

The field angles and panning and tilting of a camera imaging 
a cycle Tcycle imaging zone is described hereafter. FIG. 12 (b) is a 
drawing showing a cycle Tcycle camera 5211 equivalent in a cycle 

20 Tcycle to the camera 5201 shown in FIG. 12 (a). A time T imaging 
zone 5202, a cycle Tcycle imaging zone 5203, and a time T imaging 
zone moving path 5205 in FIG. 12 (b) are the same as those in FIG. 
12 (a). The number 5211 is a camera that images the cycle Tcycle 
imaging zone 5203. The orientation of the camera 5211 can be 

25 changed by panning and tilting operations and the field angles of the 
camera 5211 can also be changed. Here, the cycle Tcycle camera 
5211 is present in the same spatial position as the camera 5201 
although they are oriented differently. The number 5212 is a 
horizontal field angle 0b H comprising a field angle of the cycle Tcycle 

30 camera 5211 in the horizontal direction, the number 5213 is a 

vertical field angle ©b v comprising a field angle of the cycle Tcycle 
camera 5211 in the vertical direction. The camera 5201 in FIG. 12 



-25 - 



(a) images the cycle T C ycle imaging zone 5203 in a cycle Tcycle- 
Therefore, the camera 5201 is considered to be the cycle Tcycle 
camera 5211 in FIG. 12 (b) that images the cycle Tcycle imaging 
zone 5203 in a cycle Tcycle- Further in the cycle Tcycle camera 5211, 
the horizontal field angle is considered to be the horizontal field 
angle 0b H 5212 and the vertical field angle is considered to be the 
vertical field angle 0b v 5212. In a general camera such as the 
camera 5201, the field angles depend on the aspect ratio of an 
image pickup surface of a CCD and the like. Therefore, the 
horizontal field angle 0a H 5204 and vertical field angle 0a v 5205 
cannot be independently controlled. However, in the cycle Tcycle 
camera 5211, the cycle Tcycle imaging zone 5203 is determined by 
the panning and tilting operations of the camera 5201. Therefore, 
the horizontal field angle 0b H 5212 and vertical field angle 0b v 5212 
can be independently controlled of the aspect ratio of the image 
pickup surface of a CCD and the like as in a general camera. 

[0042] 

FIG. 13 (a) and (b) are illustrations showing the field angles 
20 and panning and tilting angles of the camera 5201 in FIG. 12 (a) and 
the cycle Tcycle camera 5211 in FIG. 12 (b). A camera 5201 and a 
cycle Tcycle camera 5211 in FIG. 13 (a) comprise the same as the 
camera 5201 in FIG. 12 (a) and the cycle T CY cle camera 5211 in FIG. 
12 (b), respectively. Here, the camera 5201 and cycle T C ycle 
25 camera 5211 are present in the same spatial position; however, 
these cameras are intentionally illustrated side by side in FIG. 13 (a) 
for easier understanding. The number 5220 is an additional line, 
the number 5221 is the maximum horizontal field angle 03h_max 
comprising the maximum field angle of the camera 5201 in the 
30 horizontal direction, the number 5222 is the maximum field angle 
0a h_max / 2, and the number 5223 is the maximum panning angle 
0a P _MAx comprising the maximum displacement angle of the camera 
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5201 by panning. The camera 5201 can be panned to the maximum 
panning angle 0a P MA x 5223, respectively, about the additional line 
5220. The number 5224 is the cycle T C ycle camera maximum 
horizontal field angle 0b H _MAx comprising the maximum field angle of 
5 the cycle T C ycle camera 5211 in the horizontal direction, the number 
5225 is the cycle T C ycle camera horizontal field angle 0b H comprising 
the field angle of the cycle Tcycle camera 5211 in the horizontal 
direction, the number 5226 is the cycle Tcycle camera horizontal field 
angle 0b H / 2, and the number 5227 is the cycle Tcycle camera 
10 panning angle ©b P comprising the panning angle of the cycle Tcycle 
camera 5211. 

[0043] 

A camera 5201 and a cycle Tcycle camera 5211 in FIG. 13 (b) 

15 comprise the same as the camera 5201 in FIG. 12 (a) and the cycle 
Tcycle camera 5211 in FIG. 12 (b), respectively. Here, the camera 
5201 and cycle Tcycle camera 5211 are present in the same spatial 
position; however, these cameras are intentionally illustrated side 
by side in FIG. 13 (a) for easier understanding. The number 5220 

20 is an additional line, the number 5231 is the maximum vertical field 
angle 03 V _max comprising the maximum field angle of the camera 
5201 in the vertical direction, the number 5232 is the maximum field 
angle 03 V _max / 2, and the number 5233 is the maximum tilting angle 
0ar_MAx comprising the maximum displacement angle of the camera 

25 5201 by tilting. The camera 5201 can be tilted to the maximum 
tilting angle 03t_m ax 5223 upward and downward, respectively, 
about the additional line 5220. The number 5234 is the cycle Tcycle 
camera maximum vertical field angle 0b v _MAx comprising the 
maximum field angle of the cycle Tcycle camera 5211 in the vertical 

30 direction, the number 5235 is the cycle Tcycle camera vertical field 
angle 0b v comprising the field angle of the cycle Tcycle camera 5211 
in the vertical direction, the number 5236 is the cycle Tcycle camera 
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4 



vertical field angle ©b v / 2, and the number 5237 is the cycle T C ycle 
camera tilting angle 0b T comprising the tilting angle of the cycle 
Tcycle camera 5211. 

5 [0044] 

As shown in FIG. 13 (a) and (b), the maximum horizontal field 
angle 0b H _MAx 5224 and maximum vertical field angle 0b v _MAx 5234 
of the cycle Tcycle camera 5211 are presented by the expression 1. 
The minimum horizontal field angle© b H _MiN of the cycle Tcycle 

io camera 5211 in the horizontal direction is equal to the minimum 
horizontal field angle 0a h_min of the camera 5201 in the horizontal 
direction and the minimum vertical field angle 0b v _MiN of the cycle 
Tcycle camera 5211 in the vertical direction is equal to the minimum 
vertical field angle ©a v _MiN of the camera 5201 in the vertical 

15 direction. However, when the cycle Tcycle camera 5211 is panned 
or tilted by the panning angle 0b P 5227 or by the tilting angle ©b T 
5237, the maximum vertical field angle ©b H _MAx 5224 and maximum 
vertical field angle ©b v _MAx 5234 of the cycle Tcycle camera 5221 are 
restricted by the expression 2. Therefore, the horizontal field angle 

20 ©b H 5225 and horizontal field angle ©bv 5235 of the cycle Tcycle 
camera 5211 are variable within the range presented by the 
expression 3. Further, as shown in FIG. 13 (a) and (b), the 
maximum panning angle ©b P _ M Ax and maximum panning angle 
®b T _MAx of the cycle T C ycle camera 5211 are equal to the maximum 

25 panning angle ©a P max 5223 and maximum panning angle ©aj_MAx 
5233 of the camera 5201. Then, the panning angle ©b P 5227 and 
tilting angle ©b T 5237 of the cycle Tcycle camera 5211 are variable 
within the range presented by the expression 4. 

30 [0045] 
[Math 1] 
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[0048] 
[Math 4] 

Q<0b p <9a PMAX ^ 
Q<0b r < 9a TUAX J 

5 

... (Formula 4) 

[0049] 

(Imaging zone position and view point of a camera) 

io How the imaging zone position and view point of a camera is 

calculated is described hereafter. FIG. 14 is a drawing explaining 
the imaging zone position of a camera. In FIG. 14, the number 
5301 is a lens for forming an image, the number 5302 is an image 
pickup surface of a CCD and the like for capturing the image formed 

15 by the lens 5301, and the number 5303 is a camera composed of the 
lens 5301 and image pickup surface 5302. The number 5311 is an 
Xc-axis, the number 5312 is a Y c -axis, and the number 5313 is a 
Zc-axis; these axes are orthogonal to one another and constitute a 
camera coordinates system having the origin at the lens 5301. 

20 Particularly, the Z c -axis 5313 coincides with the sight line (imaging 
direction) of the camera 5303. The number 5314 is the panning 
angle 0 P comprising a rotation angle of the camera 5303 about the 
Yc-axis 5312, the number 5315 is the tilting angle 0 T comprising a 
rotation angle of the camera 5303 about the X c -axis 5311, and the 

25 number 5316 is the rolling angle 0 R comprising a rotation angle of 
the camera 5303 about the Z c -axis 5313. The camera 5303 rotates 
by these rotation angles for orientation. The number 5317 is the 
focal length f comprising the distance from the lens 5301 to the 
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image pickup surface 5302, the number 5318 is a horizontal image 
pickup surface size W comprising the size of the image pickup 
surface 5302 in the horizontal direction, and the number 5319 is a 
vertical image pickup surface size W comprising the size of the 
5 image pickup surface 5302 in the vertical direction. The number 
5321 is an X w -axis, the number 5322 is a Y w -axis, and the number 
5323 is a Z w -axis; these axes are orthogonal to one another and 
constitute a world coordinates system. The number 5324 is a shift 
AXtw comprising a shift of the camera 5303 in the X w -axis 5321 

10 direction, the number 5325 is a shift AY T w comprising a shift of the 
camera 5303 in the Y w -axis 5322 direction, and the number 5326 is 
a shift Z T w comprising a shift of the camera 5303 in the Z w -axis 5323 
direction. The camera 5303 is present at a position (X T w, Y T w, Z T w) 
on the world coordinates system and moves from this position as the 

15 reference by (AX T w, AY TW , AZ T w). The number 5327 is a horizontal 
field angle © H comprising a field angle of the camera 5303 in the 
horizontal direction and the number 5328 is a vertical field angle © v 
comprising a field angle of the camera 5303 in the vertical direction. 
The number 5331 is a real space plane where Z w = Z C onst, the 

20 number 5332 is an imaging zone on the real space plane 5331 

comprising imaged by the camera 5303, the number 5333 is a view 
point where the Z c -axis 5313 intersects with the real space plane 
5331 on which the imaging zone 5332 is present and also the 
position of the sight line of the camera 5303 comprising presented 

25 by the Z c -axis 5313 on the real space plane. 

[0050] 

A point (Xpc, Yp C , X PC ) on the camera coordinates system 
consisting of the X c -axis 5321, Y c -axis 5322, and Z c -axis 5323 can 
30 be converted to a point (X PC , Y PC , X PW ) on the world coordinates 
system consisting of the X w -axis 5321, Y c -axis 5322, and Z w -axis 
5323 using the expression 5. In this expression, a 3x3 matrix value 
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having elements M 0 o to M 2 2 is a matrix value for the orientation 
reference of the camera 5303 (the orientation of the camera 5303 
when the rotation angles (0 P , 0 T/ 0r) = (0, 0, 0)), a 3x3 matrix value 
having elements R 0 o to R 2 2 is a matrix value for the orientation shift 
5 of the camera 5303 from the orientation reference, (X T w, Y T w, X T w) 
is the positional reference of the camera 5303 (the position of the 
camera 5303 when the positional shift (AX T w, AY T w, AX T w) = (0, 0, 
0)), and (AXtw, AY TW/ AX T w) is a positional shift of the camera 5303 
from the positional reference. 

10 
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(Formula 5) 



The 3x3 matrix value having elements M 0 o to M22 and (X T w, 
Y T w, Xtw) can be calculated by placing the camera 5303 at the 

20 orientation reference and at the positional reference or by 

conducting the calibration referred to in Non-Patent Reference 1 
below using the current orientation and position of the camera 5303 
as the orientation reference and the positional reference, 
respectively. These values are calculated before the imaging zone 

25 adjusting apparatus of the present invention starts operating. 

Non-Patent Reference 1: A Versatile Camera Calibration Technique 
for High-Accuracy 3D Machine Vision Metrology Using Off-the-Shelf 
TV Cameras and Lenses. IEEE journal of Robotics and Automation, 
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Vol. RA-3, No. 4, pp. 323-344, 1987. The 3x3 matrix value having 
elements R 0 o to R22 presenting the orientation shift of the camera 
5303 from the orientation reference can be calculated as presented 
by the expression 6 using rotation angles (0P, ©T, ©R) that reflect 
5 the orientation of the camera 5303. The rotation angles (©P, ©T, 
0R) or the orientation of the camera 5303 and the positional shift 
(AXTW, AYTW, AXTW) of the camera 5303 from the positional 
reference can be obtained by reading the shift in the stepping motor 
where the position of the camera 5303 is changed by a stepping 
10 motor. 

[0052] 
[Math 6] 



^00 ^01 



02 



j -^lo -^11 

( cosO R sin©,, 
I -sin©,, cos©„ 



0 



0 



15 



0Y1 



0 



0 Y cos ©j, 0 -sin©/ 



0 0 cosQy. sm&je 0 1 0 
1,1^0 - sinQ 7 . cosQj^ J^sin©,, 0 cos©^ > 



... (Formula 6) 

Points (Xpc, Ypc, f) on the image pickup surface 5302 can be 
20 projected on the real space plane 5331 where Z w = Z C onst by the 
expression 7. Points in the four corners of the image pickup surface, 
(-W/2, -H/2, f), (W/2, -H/2, f), (-W/2, H/2, f), and (W/2, H/2, f), 
are projected on the real space plane 5331 in the four corners of the 
imaging zone 5332 of the camera 5303. The Z c -axis 5313 passes 
25 through a point (0, 0, f) on the image pickup surface 5302. A 
projected point of the point (0, 0, f) on the real space plane 5331 
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where Z w = Zconst is the view point 5333 of the camera 5303. 
Therefore, the position (points (X PW 0/ Y PW 0/ Z PW o) to (X PW 3, Y PW 3, 
Z PW 3)) and view point 5333 (a point (X PW 4, Y PW 4/ Z PW 4)) of the 
imaging zone 5332 of the camera 5303 on the real space plane 5331 
5 where Z w = Zconst can be calculated by the expressions 8 to 12. 
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... (Formula 12) 

The horizontal field angle e H 5327 and vertical field angle 0 V 
10 5328 have the relationship presented by expression 13 with the 
focal length f 5317, horizontal image pickup surface size W 5318, 
and vertical image pickup surface size W 5319. Therefore, the 
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position and view point 5333 of the imaging zone 5232 of the camera 
5303 on the real space plane 5331 where Z w = Zconst can also be 
calculated by the expressions 14 to 17. 
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The above calculation process of the position of the imaging 
zone of a camera can be applied not only to the position and view 
point of a time T imaging zone but also to the position and view point 

10 of a cycle Tcycle imaging zone. For calculating the position and view 
point of a cycle Tcycle imaging zone, the panning angle 0 P 5314, 
tilting angle 0 T 5315, rolling angle 0 R 5316, horizontal field angle © H 
5327, and vertical field angle 0 V 5328 of the expression 13 are 
replaced by the panning angle 0b P 5227, tilting angle 0b T 5228, 

15 rolling angle 0b R/ horizontal field angle ©b H 5225, and vertical field 
angle 0b v 5335 shown in FIG. 13 (a) and (b), respectively (the 
rolling angle 0b R is not shown in FIG. 13 (a) and (b); however, it is 
equal to the rolling angle ©a R of the camera 5201). The 3x3 matrix 
value having elements M 0 o to M 2 2 comprising the matrix value of the 

20 orientation reference of the camera 5303, the positional reference 
(X T w, Y T w, Z T w) of the camera 5303, and the positional shift (AX TW , 
AY T w, aZtw) of the camera 5303 from the positional reference are 
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obtained by using those of the camera imaging the time T imaging 
zone because the position and orientation reference of the cycle 
Tcycle camera imaging the cycle T C ycle imaging zone are the same as 
those of the camera imaging the time T imaging zone. 

5 

[0064] 

(Imaging process of a cycle Tcycle imaging zone) 

The imaging process of a cycle Tcycle imaging zone is 
described hereafter. FIGS. 15 and 16 are illustrations explaining 

10 the imaging process of a cycle Tcycle imaging zone. In FIGS. 15 (a) 
and (b) and 16, the number 5401 is a cycle Tcycle imaging zone, the 
number 5402 is the horizontal size Lb H of the cycle T C ycle imaging 
zone 5401, the number 5403 is the vertical size Lb v of the cycle 
Tcycle imaging zone 5401, the number 5404 is a current time T N ow 

15 imaging zone comprising an imaging zone at a current time T N ow/ 
the number 5405 is the horizontal size La H of the current time T NO w 
imaging zone 5404, the number 5406 is the vertical size La v of the 
current time T N ow imaging zone 5404, the number 5407 is a current 
time Tnext imaging zone comprising an imaging zone at a next time 

20 Tnext to the current time T NO w/ the number 5408 is the moving 

distance L from the current time T NO w imaging zone 5404 to the next 
time T N ext imaging zone 5407, the number 5409 is the moving path 
of the time T imaging zone, the numbers 5421 to 5423 are horizontal 
positions HI to H3, respectively, and the numbers 5431 to 5434 are 

25 vertical positions VI to V4, respectively. 

[0065] 

FIGS. 17, 18, and 19 are flowcharts showing the procedures 
of the imaging process of a cycle Tcycle imaging zone. The 
30 flowcharts shown in FIGS. 17 (a) , (b) and 18 (a), (b) are for 
subroutines to move the time T imaging zone horizontally and 
vertically to the horizontal and vertical end positions. First, the 
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subroutine for leftward movement shown in FIG. 17 (a) is described. 
The subroutine starts with calculating a moving distance L 5408 in 
FIGS. 15 and 16 in Step 5501. The moving distance L 5408 is 
calculated by the expression 18. In this expression, V PC onst is a 
5 predetermined panning speed and T s is a predetermined camera 
imaging interval. Then, in Step 5502, a horizontal remaining 
distance L H comprising the distance between the left end position of 
the current time T N ow imaging zone 5404 and the horizontal end 
position is calculated. Subsequently, in Step 5503, a determination 

10 is made as to whether the horizontal remaining distance L H 

calculated in Step 5502 equal to or less than the moving distance 
L 5408 calculated in Step 5501. When the horizontal remaining 
distance L H is greater than the moving distance L 5408, the panning 
speed V P is set for the value presented by the expression 19 and the 

15 camera is panned to the left at the panning speed V P for an imaging 
time period T s (the camera is panned to the right when the panning 
speed is positive and to the left when the panning speed is negative) 
in Step 5504, and there is a return to Step 5503. On the other hand, 
when the horizontal remaining distance L H equal to or less than the 

20 moving distance L 5408, the panning speed V P is set for the value 
presented by the expression 20 and the camera is panned to the left 
at the panning speed V P for an imaging time period T s . 
Consequently, in Step 5504, the camera is continuously panned to 
the left at the panning speed V P presented by the expression 19 until 

25 the horizontal remaining distance L H becomes equal to or less than 
the moving distance L 5408. Further, in Step 5505, the camera is 
panned to the left at the panning speed V P presented by the 
expression 20 for an imaging time period Ts, whereby the camera is 
panned to the left over the horizontal remaining distance L H and the 

30 time T imagining zone of the camera reaches the horizontal end 
position. 
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The subroutine for leftward movement shown in FIG. 17 (b) is 
described hereafter. The subroutine provides nearly the same 
operation as the subroutine for rightward movement shown in FIG. 

20 17 (a). The subroutine starts by calculating a moving distance L 
5408 in FIGS. 15 and 16 in Step 5511. The moving distance L 5408 
is calculated by the expression 18. Then, in Step 5512, a horizontal 
remaining distance L H comprising the distance between the right end 
position of the current time T NO w imaging zone 5404 and the 

25 horizontal end position is calculated. Subsequently, in Step 5513, a 
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determination is made as to whether the horizontal remaining 
distance L H calculated in Step 5512 is equal to or less than the 
moving distance L 5408 calculated in Step 5511. When the 
horizontal remaining distance L H is greater than the moving distance 
5 L 5408, the panning speed V P is set for the value presented by the 
expression 21 and the camera is panned to the right at the panning 
speed V P for an imaging time period T s in Step 5514, and there is a 
return to Step 5513. On the other hand, when the horizontal 
remaining distance L H is equal to or less than 1 the moving 

10 distance L 5408, the panning speed V P is set for the value presented 
by the expression 22 and the camera is panned to the right at the 
panning speed V P for an imaging time period T s . Consequently, in 
Step 5514, the camera is continuously panned to the right at the 
panning speed V P presented by the expression 22 until the 

15 horizontal remaining distance L H becomes equal to or less than the 
moving distance L 5408. Further, in Step 5515, the camera is 
panned to the right at the panning sped V P presented by the 
expression 22 for an imaging time period T s , whereby the camera is 
panned to the right over the horizontal remaining distance L H and 

20 the time T imagining zone of the camera reaches the horizontal end 
position. 

[0069] 
[Math 21] 



V = V 

...(Formula 21) 



30 [0070] 
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[Math 22] 



V P =^ 
T 



(Formula 22) 



The subroutine for upward movement shown in FIG. 18 (a) is 
described hereafter, and provides nearly the same operation as the 

10 subroutine for rightward movement shown in FIG. 17 (a). The 

subroutine starts by calculating the moving distance L 5408 in FIGS. 
15 and 16 in Step 5521, calculated by the expression 23. Then, in 
Step 5522, a vertical remaining distance L v comprising the distance 
between the top end position of the current time T NO w imaging zone 

15 5404 and the vertical end position is calculated. Subsequently, in 
Step 5523, a determination is made as to whether the vertical 
remaining distance L v calculated in Step 5522 equal to or less than 
the moving distance L 5408 calculated in Step 5521. When the 
vertical remaining distance L v is greater than the moving distance L 

20 5408, the tilting speed V T is set for the value presented by the 

expression 24 and the camera is panned upward at the tilting speed 
V T for an imaging time period T s (the camera is tilted upward when 
the tilting speed is positive and downward when the tilting speed is 
negative) in Step 5524, and there is a return to Step 5523. On the 

25 other hand, when the vertical remaining distance L v is equal to or 
less than the moving distance L 5408, the tilting speed V T is set for 
the value presented by the expression 25 and the camera is tilted 
upward at the tilting speed V T for an imaging time period T s . 

Consequently, in Step 5524, the camera is continuously tilted 

30 upward at the tilting speed V T presented by the expression 24 until 
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the vertical remaining distance L v becomes equal to or less than the 
moving distance L 5408. Further, in Step 5525, the camera is tilted 
upward at the tilting speed V T presented by the expression 25 for an 
imaging time period T S/ whereby the camera is tilted upward over 
5 the vertical remaining distance L T and the time T imagining zone of 
the camera reaches the vertical end position. 



[0071] 
[Math 23] 



10 



L = V. I 



T CONST 



...(Formula 23) 



15 



[0072] 
[Math 24] 




T CONST 



20 



...(Formula 24) 



[0073] 
[Math 25] 



25 
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1 



...(Formula 25) 

Finally, the subroutine for downward movement shown in FIG. 
5 18 (b) is described hereafter, and provides nearly the same 

operation as the subroutine for rightward movement shown in FIG. 
17 (a). The subroutine starts with calculating a moving distance L 
5408 in FIGS. 15 and 16 in Step 5531. The moving distance L 5408 
is calculated by the expression 23. Then, in Step 5532, a vertical 

10 remaining distance L v comprising the distance between the bottom 
end position of the current time T N ow imaging zone 5404 and the 
vertical end position is calculated. Subsequently, in Step 5533, a 
determination is made as to whether the vertical remaining distance 
L v calculated in Step 5532 equal to or less than the moving 

15 distance L 5408 calculated in Step 5531. When the vertical 

remaining distance L v is greater than the moving distance L 5408, 
the tilting speed V T is set for the value presented by the expression 
26 and the camera is panned downward at the tilting speed V T for an 
imaging time period T s in Step 5534, and there is a return to Step 

20 5533. On the other hand, when the vertical remaining distance L v 
equal to or less than the moving distance L 5408, the tilting speed V T 
is set for the value presented by the expression 27 and the camera 
is tilted downward at the tilting speed V T for an imaging time period 
T s . Consequently, in Step 5534, the camera is continuously tilted 

25 downward at the tilting speed V T presented by the expression 26 
until the vertical remaining distance L v becomes equal to or less 
than the moving distance L 5408. Further, in Step 5535, the 
camera is tilted downward at the tilting speed V T presented by the 
expression 27 for an imaging time period T s , whereby the camera is 

30 tilted downward over the vertical remaining distance L T and the time 
T imagining zone of the camera reaches the vertical end position. 
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[0074] 
[Math 26] 



V = V 

V T v T_CONST 

5 ...(Formula 26) 

[0075] 
[Math 27] 




...(Formula 27) 

As described above, according to the flowcharts of the 
15 subroutines shown in FIGS. 17 (a), (b) and 18 (a), (b), the time T 
imaging zone can be shifted horizontally and vertically to the 
horizontal and vertical end positions. The predetermined panning 
and tilting speeds V P const and V t _const and imaging interval Ts have 
the relationship presented by the expression 28 with the horizontal 
20 time T imaging zone size La H 5405 and vertical time T imaging zone 
size Lav 5406. 

[0076] 
[Math 28] 

25 
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.(Formula 28) 



5 The flowchart shown in FIG. 19 is a flowchart for a main 

routine to move the time T imaging zone along the time T imaging 
zone moving path 5409 in FIG. 15 (a) using the subroutines shown 
in FIGS. 17 (a), (b) and 18 (a), (b), thereby imaging the cycle T C ycle 
imaging zone 5401. First, in Step C541, the time T imaging zone of 

10 the camera is moved to the bottom right position of the cycle T C ycle 
imaging zone 5401 as the current time T NO w imaging zone 5404 in 
FIG. 15 (a). Then, in Steps 5542 and 5543, with the horizontal end 
position at the position HI (5421), the camera is panned to the right 
up to the position HI (5421) using the subroutine shown in FIG. 17 

15 (b). Then, in Steps 5544 and 5545, with the vertical end position at 
the position VI (54231), the camera is tilted upward up to the 
position VI (5431) using the subroutine shown in FIG. 18 (a). Then, 
in Steps 5546 and 5547, with the horizontal end position at the 
position H2 (5422), the camera is panned to the left up to the 

20 position H2 (5422) using the subroutine shown in FIG. 17 (a). Then, 
in Steps 5548 and 5549, with the vertical end position at the position 
V2 (5432), the camera is tilted upward up to the position V2 (5432) 
using the subroutine shown in FIG. 18 (a). Then, in Steps 5550 and 
5551, with the horizontal end position at the position H3 (5423), the 

25 camera is panned to the right up to the position H3 (5423) using the 
subroutine shown in FIG. 17 (b), and there is a return to Step 541. 
According to the flowchart, the time T imaging zone is moved along 
the time T imaging zone moving path 5409 of FIG. 15 (a) so as to 
image the cycle Tcycle imaging zone 5401. 
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[0077] 

In FIG. 19 shown is the flowchart to move the time T imaging 
zone along the time T imaging zone moving path 5409 in FIG. 15 (a), 
5 thereby imaging the cycle Tcycle imaging zone 5401. It is obvious 
and, therefore, not described here that the horizontal and vertical 
end positions and subroutines shown in FIGS. 17 (a), (b) and 18 (a), 
(b) can be used in different order for imaging when the time T 
imaging zone is moved along the time T imaging zone moving path 
10 5409 in FIG. 15 (b) or the time T imaging zone is moved along the 
time T imaging zone moving path 5409 in FIG. 16, thereby imaging 
the cycle Tcycle imaging zone 5401. 

[0078] 

15 The positions HI (4321) to H3 used as the horizontal end 

position and the positions VI (5431) to V4 (5434) used as the 
vertical end position each can be calculated using the relationship of 
the horizontal cycle Tcycle imaging zone size Lb H 5402, vertical cycle 
Tcycle imaging zone size Lbv 5403, horizontal time T imaging zone 

20 size La H 5405, and vertical time T imaging zone size La v 5406. For 
example, when the vertical cycle Tcycle imaging zone size Lb v 5403 
is 2.8 times greater than the vertical time T imaging zone size La v 
5406, the position VI (5431) in FIG. 15 (a) can be double the 
vertical imaging zone size La v (5406) and the position V2 (5432) in 

25 FIG. 15 (a) can be 2.8 times greater than the vertical imaging zone 
size La v 5406. The position V2 (5432) in FIG. 15 (a) can also be 3 
times greater than the vertical imaging zone size La v 5406. When 
the position V2 (5432) in FIG. 15 (a) is 3 times greater than the 
vertical imaging zone size La v 5406, the time T imaging zone runs off 

30 the edge of the cycle Tcycle imaging zone 5401; however, the cycle 
Tcycle imaging zone 5401 is completely imaged and no problems 
occur. 
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[0079] 

The horizontal cycle T C ycle imaging zone size Lb H 5402, 
vertical cycle Tcycle imaging zone size Lb v 5403, horizontal time T 
5 imaging zone size La H 5405, and vertical time T imaging zone size 
La v 5406 can be obtained by the calculation process of the camera 
imaging zone position described above based on the four corner 
positions of the cycle Tcycle imaging zone and time T imaging zone 
obtained from the panning angle 0 P , tilting angle 0 T , rolling angle 
10 0R P , horizontal field angle 0 H , and vertical field angle © v . 

[0080] 

FIGS. 15 (a), (b) and 16 show three examples of the time T 
imaging zone moving path 5409. However, the time T imaging zone 
15 moving path 5409 is not restricted thereto. Any path that allows 
the cycle Tcycle imaging zone 5401 to be thoroughly imaged, with a 
single stroke if possible, can be used. 

[0081] 

20 The time T imaging zone moving path 5409 can be selected 

from the time T imaging zone moving path 5409 shown in FIGS. 15 
(a), (b) and 16 depending on the horizontal cycle Tcycle imaging 
zone size Lb H 5402, vertical cycle Tcycle imaging zone size Lb v 5403, 
horizontal time T imaging zone size La H 5405, and vertical time T 

25 imaging zone size La v 5406. 

[0082] 

The above explanation is made on the assumption that the 
cycle Tcycle imaging zone is greater than the time T imaging zone. 
30 According to FIG. 12 (a) and (b), when the cycle Tcycle imaging zone 
is equal to or smaller than the time T imaging zone such as the time 
T camera horizontal field angle ©a H ^ the cycle Tcycle camera 
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horizontal field angle 0b H , the time T camera vertical field angle 0a v 
> the cycle T C ycle camera vertical field angle 0b V/ and the horizontal 
and vertical field angles of the cycle Tcycle imaging zone 5203 are 
equal to or less than those of the time T imaging zone 5302, the 
5 entire cycle Tcycle imaging zone can be imaged at a time with the 
time T imaging zone. In such a case, the time T imaging zone 
position is not sequentially moved by the technique described above. 
Instead, the position (panning/tilting/rolling angles) and size (zoom 
ratio) of the time T imaging zone is adjusted to image the entire 

10 cycle Tcycle imaging zone. In such a case, the cycle T C ycle imaging 
zone has a cycle of 0 and the entire cycle Tcycle imaging zone is 
constantly imaged. The position and size of the time T imaging 
zone should be adjusted so that the entire cycle T C ycle imaging zone 
is imaged with the time T imaging zone and the area within the time 

15 T imaging zone where the cycle Tcycle imaging zone is not imaged is 
minimized. As described above, the cycle Tcycle imaging zone 
includes not only a zone greater than the time T imaging zone but 
also a zone equal to or smaller than the time T imaging zone. 

20 [0083] 

(Shape of the imaging zone) 

The shape of the time T imaging zone and cycle Tcycle imaging 
zone is described hereafter. FIG. 20 is an illustration explaining the 
shape of the time T imaging zone. In FIG. 20, the number 5301 is 

25 a lens, the number 5302 is an image pickup surface, the number 
5303 is a camera, the number 5313 is a Z c -axis, the number 5321 is 
an Xw-axis, the number 5322 is a Y w -axis, the number 5323 is a 
Zw-axis, and the number 5332 is a time T imaging zone. The 
elements are the same as those in FIG. 14. The number 5601 is a 

30 quadrangle that inscribes the time T imaging zone 5332 and has 
sides parallel to the X w -axis 5321 and Y w -axis 5322. The numbers 
5610 to 5613 are positions XI to X4 that comprise four corner 
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positions of the time T imaging zone 5332 on the X w -axis 5321. 
The numbers 5620 to 5623 are positions Yl to Y4 that comprise four 
corner positions of the time T imaging zone 5332 on the Y w -axis 
5322. 

5 

[0084] 

In the embodiment, the time T imaging zone and cycle T C ycle 
imaging zone are quadrangles having sides parallel to the X w -axis 
5321 and Y w -axis 5322 for simplified explanation. However, as 

10 shown in FIG. 20, the time T imaging zone 5332 of the camera 5303 
is a rectangular having sides not parallel to the X w -axis 5321 and 
Yw-axis 5322 when the Z c -axis 5313 that coincides with the imaging 
direction of the camera 5303 is not parallel to the Z w -axis 5323. In 
such a case, the time T imaging zone is assumed to be a quadrangle 

15 inscribing the time T imaging zone 5323 and having sides parallel to 
the Xw-axis 5321 and Y w -axis 5322 shown as the time T imaging 
zone-inscribed quadrangle 5601. The four corner positions of the 
time T imaging zone-inscribed quadrangle 5601 can be obtained by 
comparing the positions XI (5620) to X3 (5623) comprising the four 

20 corner positions of the time T imaging zone 5332 on the X w -axis 

5321 and the positions Yl (5630) to Y3 (5633) comprising the four 
corner positions of the time T imaging zone 5332 on the Y w -axis 

5322 in magnitude, respectively, as shown in FIG. 20. The second 
and third largest positions among the positions XI (5620) to X3 

25 (5623) and the second and third largest positions among the 

positions Yl (5630) to Y3 (5633) comprise the four corner positions 
of the time T imaging zone-inscribed quadrangle 5601. Here, the 
time T imaging zone-inscribed quadrangle 5601 is not necessarily a 
quadrangle obtained as described above, but can be any rectangular 

30 that inscribes the time T imaging zone 5332 and has sides parallel to 
the Xw-axis 5321 and Y w -axis 5322. The positions XI (5620) to X3 
(5623) and positions Yl (5630) to Y3 (5633) can be obtained by the 
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calculation process of a camera imaging zone position described 
above using the panning angle 0 P , tilting angle © T , rolling angle 0 R , 
horizontal field angle 0 H/ and vertical field angle 0 V . 

5 [0085] 

FIG. 21 is an illustration explaining the shape of the cycle 
Tcycle imaging zone. In FIG. 21, the number 5321 is an X w -axis, 
the number 5322 is a Y w -axis, and the number 5332 is a time T 
imaging zone. These elements are the same as those in FIG. 14. 

10 The number 5630 is a cycle Tcycle imaging zone, the number 5631 is 
a quadrangle that inscribes the cycle Tcycle imaging zone 5630 and 
has sides parallel to the X w -axis 5321 and Y w -axis 5322, the 
numbers 5640 to 5643 are positions X4 to X7 that comprise four 
corner positions of the cycle Tcycle imaging zone 5630 on the X w -axis 

15 5321, and the numbers 5650 to 5653 are positions Y4 to Y7 that 
comprise four corner positions of the cycle Tcycle imaging zone 5630 
on the Yw-axis 5322. As shown in FIG. 21, similar to the time T 
imaging zone 5332, the cycle Tcycle imaging zone 5630 may be a 
rectangular having sides not parallel to the X w -axis 5321 and 

20 Yw-axis 5322. In such a case, the cycle Tcycle imaging zone is 

assumed to be a quadrangle inscribing the cycle Tcycle imaging zone 
5630 and having sides parallel to the X w -axis 5321 and Y w -axis 5322 
shown as the cycle Tcycle imaging zone-inscribed quadrangle 5631. 

25 [0086] 

The four corner positions of the cycle Tcycle imaging 
zone-inscribed quadrangle 5631 can be obtained by comparing the 
positions X4 (5640) to X7 (5643) comprising the four corner 
positions of the cycle Tcycle imaging zone 5630 on the X w -axis 5321 
30 and the positions Y4 (5650) to Y7 (5653) comprising the four corner 
positions of the cycle Tcycle imaging zone 5630 on the Y w -axis 5322 
in magnitude, respectively, as shown in FIG. 21. The second and 
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third largest positions among the positions X4 (5640) to X7 (5643) 
and the second and third largest positions among the positions Y4 
(5650) to Y7 (5653) comprise the four corner positions of the cycle 
Tcycle imaging zone-inscribed quadrangle 5631. Here, the cycle 
5 Tcycle imaging zone-inscribed quadrangle 5631 is not necessarily a 
quadrangle obtained as described above, but can be any quadrangle 
that inscribes the cycle Tcycle imaging zone 5630 and has sides 
parallel to the X w -axis 5321 and Y w -axis 5322. The positions X4 
(5640) to X7 (5643) and positions Y4 (5650) to Y7 (5653) can be 
io obtained by the calculation process of a the camera imaging zone 
position described above using the panning angle 0 P , tilting angle © T , 
rolling angle 0 R , horizontal field angle © H , and vertical field angle 0 V . 

[0087] 

15 (Adjacent imaging zones) 

Adjacent imaging zones are described hereafter. Adjacent 
imaging zones comprise the nearest other imaging zones to an 
imaging zone in question in the horizontal or vertical direction. The 
procedure to obtain adjacent imaging zones to an imaging zone in 

20 question is described hereafter. 

[0088] 

First, the direction in which other imaging zones are present 
is determined for the imaging zone in question. The determination 

25 process shown in FIG. 22 is used for this determination. FIG. 22 is 
an illustration explaining the zone determination process. In FIG. 
22, the number 5701 is a point A at coordinates (X A , Y A ), the number 
5702 is a point B at coordinates (X B , Y B ), the number 5703 is a line 
AB passing through the points A 5701 and B 5702, the number 5704 

30 is the top right zone A divided by the line AB 5703, and the number 
5705 is the top right zone B divided by the line AB 5703. In FIG. 22, 
the expression 29 is satisfied when a point Z at coordinates (X z , Y z ) 
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is present in the zone A 5704,. When point Z is present in the zone 
B 5705, the expression 30 is satisfied (when point Z is present on 
line AB 5703, it is assumed that the point is present in the zone B 
5705). With the expressions being evaluated, it is determined in 
5 which zone the point Z is present, the zone A 5704 or the zone B 
5705. 

[0089] 

Using the process described above and assuming that the 

10 point Z is the gravity center of another imaging zone (the average of 
vertexes of the imaging zone), it is determined in which direction the 
imaging zone is present. FIG. 23 (a), (b), (c), and (d) are 
illustrations explaining in which direction another imaging zone is 
present for an imaging zone in question. In FIG. 23, the number 

15 5801 is a cycle Tcycle imaging zone, which corresponds to an 

imaging zone in question. The number 5802 is a first vertex A of 
the cycle T C ycle imaging zone 5801 at coordinates (X A , X A ), the 
number 5803 is a second vertex B of the cycle T C ycle imaging zone 
5801 at coordinates (X B , X B ), the number 5804 is a third vertex C of 

20 the cycle T CY cle imaging zone 5801 at coordinates (X c , X c ), the 
number 5805 is a fourth vertex D of the cycle T C ycle imaging zone 
5801 at coordinates (X D , X D ), the number 5806 is a zone A above the 
cycle Tcycle imaging zone 5801 or an imaging zone in question, the 
number 5807 is a zone B to the right of the cycle Tcycle imaging zone 

25 5801 or an imaging zone in question, the number 5808 is a zone C 
below the cycle Tcycle imaging zone 5801 or an imaging zone in 
question, and the number 5809 is a zone D to the left of the cycle 
Tcycle imaging zone 5801 or an imaging zone in question. 

30 [0090] 

[Math 29] 
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[0091] 
[Math 30] 



(Y Z -Y A )> £ B ¥ £ f Xz-XJ 



...(Formula 30) 



10 Using the determination process shown in FIG. 22, when the 

expressions 29 and 31 are satisfied in FIG. 23 (a), it is determined 
that the point Z comprising the gravity center of another imaging 
zone is present in the zone A 5806 and the other imaging zone is 
above the imaging zone in question. When the expressions 29 and 

15 32 are satisfied, it is determined that the point Z comprising the 
gravity center of another imaging zone is present in the zone B 5807 
and the other imaging zone is to the right of the imaging zone in 
question. When the expressions 30 and 32 are satisfied, it is 
determined that the point Z comprising the gravity center of another 

20 imaging zone is present in the zone C 5808 and the other imaging 
zone is below the imaging zone in question. Finally, when the 
expressions 30 and 31 are satisfied, it is determined that the point 
Z comprising the gravity center of another imaging zone is present 
in the zone D 5809 and the other imaging zone is to the left of the 

25 imaging zone in question. 
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[0092] 
[Math 31] 



10 
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(Formula 31) 



[0093] 
[Math 32] 



...(Formula 32) 



Among the other imaging zones, the nearest one in each 
15 direction is assumed to be the adjacent imaging zone in that 
direction. If only one other imaging zone is found in a certain 
direction according to the process above, the zone is assumed to be 
the adjacent imaging zone in that direction. If multiple zones are 
found, the zone of which the gravity center is the nearest to the 
20 gravity center of the imaging zone in question is assumed to be the 
adjacent imaging zone. 



[0094] 

The process to obtain the adjacent imaging zone to an 
25 imaging zone in question is as described above. In the process, the 
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point Z used for the determination is the gravity center of another 
imaging zone. However, the point Z can be the view point of 
another imaging zone. Similarly, the distance between the gravity 
centers of an imaging zone in question and another imaging zone 
5 can be the distance between the view points of an imaging zone in 
question and another imaging zone. 

[0095] 

In the process described above, as shown in FIG. 23 (a), the 
zone is divided into top, bottom, right, and left zones so as to obtain 
the adjacent imaging zone in each zone. Alternatively, the zone 
can be divided into top, bottom, right, left, top right, top left, 
bottom right, and bottom left zones by the lines passing through the 
vertexes of the cycle Tcycle imaging zone 5801 (indicated by the 
broken lines in FIG. 23) so as to obtain the adjacent imaging zone in 
each zone as shown in FIG. 23 (b). In the above explanation of the 
process, the cycle Tcycle imaging zone 5801 is two-dimensional as 
shown in FIG. 23 (a). Needless to say, the adjacent imaging zone 
can be similarly obtained for a three-dimensional cycle Tcycle 
imaging zone 5801 as shown in FIG. 23 (c) and (d). 

[0096] 

(Zone dividing) 

Finally, the zone dividing process is described. FIGS. 24 (a), 
25 (b), (c) and 25 (a), (b) are illustrations explaining the zone dividing 
process. In FIGS. 24 and 25, the numbers 5901 to 5903 indicate 
cameras A to C, respectively, the number 5904 is an imaging target 
zone comprising a target zone to be imaged by the cameras A 5901 
to C 5903, the numbers 5911 to 5913 indicate the view points of the 
30 cameras A 5901 to C 5903, respectively, the number 5921 is a line 
AB comprising a perpendicular bisector of the line connecting the 
view points A 5911 and B 5912 of the cameras A 5901 and B 5902, 
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the number 5922 is a line BC comprising a perpendicular bisector of 
the line connecting the view points B 5912 and C 5913 of the 
cameras B 5902 and C 5903, the number 5923 is a line AC 
comprising a perpendicular bisector of the line connecting the view 
5 points A 5911 and C 5913 of the cameras A 5901 and C 5903, the 
numbers 5931 to 5933 indicate zones A to C divided by the lines AB 
5931, BC 5932, and AC 5933, respectively. 

[0097] 

io First, as shown in FIG. 24 (b), (c) and 25 (a), the 

perpendicular bisectors AB, 5931, BC 5932, and AC 5933 of the lines 
each connecting the view points A 5911 to C 5913 of the cameras A 
5901 to C 5903 are obtained. The perpendicular bisectors are 
obtained, for example, by the expression 33 provided that the view 

15 points are present at coordinates (X A , Y A ) and (X B , Y B ). Then, a 
zone enclosed by the perpendicular bisectors of the lines connecting 
the view points of one's own camera and other cameras and the 
boundaries of the imaging target zone is assumed to be one's own 
division. For the camera A 5901, as shown in FIG. 24 (b), the zone 

20 A 5931 enclosed by the lines AB 5931 and AC 5933 and the 

boundaries of the imaging target zone is the division for the camera 
A 5901. Similarly, for the camera B 5902, as shown in FIG. 24 (c), 
the zone B 5932 is the division for the camera B 5902. For the 
camera C 5903, as shown in FIG. 25 (a), the zone C 5933 is the 

25 division for the camera C 5903. Consequently, as shown in FIG. 25 
(b), the imaging target zone 5904 is divided into the zones A 5931 
to C 5933 for the cameras. 

[0098] 
30 [Math 33] 
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In the dividing process described above, perpendicular 
5 bisectors based on the view points of the cameras are used to divide 
the zone. Needless to say, similar divisions can be obtained by 
using the gravity centers of the imaging zones of the cameras. 

[0099] 

io The imaging zone of a camera, relationship between a 

detection target and a cycle T C ycle imaging zone, size of a cycle 
Tcycle imaging zone of a camera, field angles and panning and tilting 
of a camera imaging a cycle T C ycle imaging zone, position of the 
imaging zone of a camera, imaging process of a cycle T C ycle imaging 

15 zone, shape of an imaging zone, adjacent imaging zone, and zone 
dividing are described above. On the premises of these, 
embodiments of the present invention are described hereafter with 
reference to the drawings. 

20 [0100] 

(First Embodiment) 

The First Embodiment of the present invention is described 
hereafter. In the embodiment, an imaging zone adjusting 
25 apparatus in which the cycle T C ycle imaging zones of the cameras of 
the camera terminals are self-adjusted so that a combined zone of 
the cycle Tcycle imaging zones of the cameras of the camera 
terminals completely covers a specific imaging target zone is 
described with reference to FIGS. 26 to 31. 
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[0101] 

First, components of the imaging zone adjusting apparatus of 
the embodiment are described. FIG. 26 (a) is a block diagram 
5 showing the structure of the imaging zone adjusting apparatus of 
the embodiment. The imaging zone adjusting apparatus comprises 
camera terminals 101A to 101C, an operation terminal 102, and a 
network 103 used for communication among the camera terminals 
101A to C101C and operation terminal 102. In FIG. 26, an X w -axis 

10 110, a Yw-axis 111, and a Z w -axis 112, which are orthogonal to each 
other, are defined for indicating zones and positions of the zones. 
The number 113 is a plane in the real space in which the camera 
terminals 101A to 101C are present; for example, it is a floor surface 
when the camera terminals 101 A to 101C are suspended from the 

15 ceiling downward. In the embodiment, a plane where the Z w -axis 
112 = 0 is used. Various zones and positions of the zones are 
expressed based on the plane. On the real space plane 113, a cycle 
TAcycle imaging zone 120A is a zone that is periodically imaged by 
the camera terminal 101A in a cycle TAcycle, a cycle TBcycle imaging 

20 zone 120B is a zone that is periodically imaged by the camera 

terminal 101B in a cycle TBcycle, a cycle TCcycle imaging zone 120C 
is a zone that is periodically imaged by the camera terminal 101C in 
a cycle TCcycle, an imaging target zone 121 is a target zone to be 
imaged in the present invention, and a non-imaging zone 122 is a 

25 zone excluded from the image target zone 121. 

[0102] 

FIG. 26 (b) is an illustration showing the positions of the 
imaging zones on the real space plane 113 in the imaging zone 
30 adjusting apparatus of the embodiment shown in FIG. 26 (a) in 

detail. An X w -axis 110, a Y w -axis 111, a cycle TAcycle imaging zone 
120A, a cycle TBcycle imaging zone 120B, a cycle TCcycle imaging 



-63 - 



zone 120C, an imaging target zone 121, and a non-imaging zone 
122 in FIG. 26 (b) are the same as those in FIG. 26 (a). 

[0103] 

5 The numbers 130AL, 130AR, 130AU, and 130 AB comprise the 

left end X A l, right end X A r, top end Y A u, and bottom end Yab positions 
of the cycle TAcycle imaging zone 120A. In other words, the cycle 
TAcycle imaging zone 120A is a zone enclosed by X A l 130AL, X A r 
130AR, Y AU 130AU, and Y AB 130AB and the position of the cycle 

10 TAcycle imaging zone 120A is expressed by these. The numbers 
130BL, 130BR, 130BU, and 130 BB comprise the left end X BL , right 
end X B r, top end Y B u/ and bottom end Y B b positions of the cycle 
TBcycle imaging zone 120B. In other words, the cycle TBcycle 
imaging zone 120A is a zone enclosed by X B l 130BL, X BR 130BR, Y BU 

15 130BU, and Y BB 130BB and the position of the cycle TBcycle imaging 
zone 120B is expressed by these. The numbers 130CL, 130CR, 
130CU, and 130CB comprise the left end X C l, right end X C r, top end 
Y C u/ and bottom end Y CB positions of the cycle TCcycle imaging zone 
120C. In other words, the cycle TCcycle imaging zone 120A is a 

20 zone enclosed by X CL 130CL, X CR 130CR, Y cu 130CU, and Y CB 130CB 
and the position of the cycle TCcycle imaging zone 120C is expressed 
by these. The numbers 131TL, 131TR, 131TU, and 131TB comprise 
the left end X T l, right end X T r, top end Y T u, and bottom end Y TB 
positions of the imaging target zone 121. In other words, the 

25 imaging target zone 121 is a zone enclosed by X T l 131TL, X T r 131TR, 
Y T u 131TU, and Y TB 131TB and the non-imaging zone 122 is a zone 
excluded from the zone enclosed by X T l 131TL, X T r 131TR, Y T u 131TU, 
and Y TB 131TB, by which the positions of the imaging target zone 
121 and non-imaging zone 122 are expressed. 

30 

[0104] 

A zone enclosed by X BL 130BL, X AR 130AR, Y BU 130BU, and Y AB 
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130AB where the cycle TA C ycle imaging zone 120A and cycle TBcycle 
imaging zone 120B overlap is a zone double imaged by the camera 
terminals 101A and 101B. The zone is termed an imaging 
overlapping zone AB. The zone has a measure of X A r - X B l in the 
5 Xw-axis direction 110. A zone enclosed by X C l 130CL, X B r 130BR, 
Y cu 130CU, and Y BB 130BB where the cycle TBcycle imaging zone 
120B and cycle TCcycle imaging zone 120C overlap is a zone double 
imaged by the camera terminals 101B and 101C. The zone is 
termed an imaging overlapping zone BC. The zone has a measure 

10 of X BR - Xcl in the X w -axis direction 110. A zone enclosed by X A l 
130AL, X TL 131TL, Y AU 130AU, and Y AB 130AB where the non-imaging 
zone 122 and cycle TAcycle imaging zone 120A overlap is termed a 
non-imaging overlapping zone AL. The zone has a measure of X TL - 
X AL in the X w -axis direction 110. A zone enclosed by X T r 131TR, X C r 

15 130CR, Y cu 130CU, and Y CB 130CB where the non-imaging zone 122 
and cycle TCcycle imaging zone 120C overlap is termed a 
non-imaging overlapping zone CR. The zone has a measure of X C r 

- X T r in the Xw-axis direction 110. A zone enclosed by X AL 130AL, 
X A r 130AR, Y AU 130AU, and Y T u 131TU where the non-imaging zone 

20 122 and cycle TA C ycle imaging zone 120A overlap is termed a 

non-imaging overlapping zone AU. The zone has a measure of Y T u 

- Y AU in the Y w -axis direction 111. A zone enclosed by X AL 130AL, 
X AR 130AR, Y TB 131TB, and Y AB 130AB where the non-imaging zone 
122 and cycle TAcycle imaging zone 120A overlap is termed a 

25 non-imaging overlapping zone AB. The zone has a measure of Y AB - 
Y TB in the Y w -axis direction 111. A zone enclosed by X BL 130BL, X BR 
130BR, Y BU 130BU, and Y TU 131TU where the non-imaging zone 122 
and cycle TBcycle imaging zone 120B overlap is termed a 
non-imaging overlapping zone BU. The zone has a measure of Y T u 

30 - Y BU in the Y w -axis direction 111. A zone enclosed by X BL 130BL, 
X BR 130BR, Y TB 131TB, and Y BB 130BB where the non-imaging zone 
122 and cycle TBcycle imaging zone 120B overlap is termed a 
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non-imaging overlapping zone BB. The zone has a measure of Y B b - 
Y T b in the Y w -axis direction 111. A zone enclosed by X C l 130CL, X C r 
130CR, Ycu 130CU, and Y TU 131TU where the non-imaging zone 122 
and cycle TCcycle imaging zone 120C overlap is termed a 
5 non-imaging overlapping zone CU. The zone has a measure of X T u 
- X C u in the Y w -axis direction 111. A zone enclosed by X C l 130CL, 
X C r 130CR, Ytb 131TB, and Y CB 130CB where the non-imaging zone 
122 and cycle TCcycle imaging zone 120C overlap is termed a 
non-imaging overlapping zone CB. The zone has a measure of X C b 
io - X T b in the Y w -axis direction 111. 

[0105] 

FIG. 27 is a block diagram showing the structure of the 
camera terminals 101A to 101C in FIG. 26 (a). The camera 
15 terminals 101A to 101C each comprise a camera 201, an adjusting 
unit A 202 comprising a processor to adjust the imaging zone 
position of the camera 201, and a communications unit 203 to 
transmit the imaging zone position of the camera 201 via a network 
103. 

20 

[0106] 

The camera 201 is, for example, a camera that repeatedly 
captures images of a hypothetical imaging zone comprising a 

25 hypothetical imaging zone obtained by changing the imaging zone 
position within a specific zone in a specific period of time and a 
specific cycle. The camera 201 further comprises a lens 211, an 
image pickup surface 212, an image processor 213, an orientation 
controller 214, and a cycle imaging controller 215. The lens 211 is 

30 a lens forming images. The image pickup surface 212 is an image 
pickup surface of a CCD and the like that captures images formed by 
the lens 211. The image processor 312 is a processor that 
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processes images captured by the image pickup surface 212. The 
orientation controller 214 is a processor that controls the orientation 
of the lens 211 and image pickup surface 212 and the distance 
between the lens 211 and image pickup surface 212. The cycle 
imaging controller 215 is a processor that sends periodic orientation 
control signals to the orientation controller 214 so that the camera 
201 images the cycle T C ycle imaging zone in a cycle T C ycle- The 
orientation control of the lens 211 and image pickup surface 212 
conducted by the orientation controller 214 controls so-called 
panning and tilting. The lens 211 and image pickup surface 212 are 
rotated about a point or an axis in association with each other. The 
distance control between the lens 211 and image pickup surface 212 
conducted by the orientation controller 214 is a so-called zooming 
control. The distance between the lens 211 and image pickup 
surface 212 is increased or decreased to adjust the field angle of the 
camera 201. 

[0107] 

The communications unit 203 is a communication interface to 
20 exchange hypothetical imaging zone information indicating the 
hypothetical imaging zone. Here, it exchanges hypothetical zone 
positions with other cameras. 

[0108] 

25 The adjusting unit A 202 is a processor to control the camera 

201 and, accordingly, the hypothetical imaging zone position. Here, 
it adjusts the hypothetical imaging zone position of one's own 
camera terminal based on the hypothetical imaging zone of one's 
own camera terminal and the hypothetical imaging zones of other 

30 camera terminals indicated by information received by the 
communications unit 203 so that a combined zone of the 
hypothetical imaging zones of multiple camera terminals 
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constituting the imaging zone adjusting apparatus completely 
covers the imaging target zone. For example, it adjusts the 
hypothetical imaging zone position of one's own camera terminal so 
that an overlapping zone amount comprising the quantity of an 
5 overlapping zone where the hypothetical imaging zone of one's own 
camera terminal and the hypothetical imaging zone of another 
camera terminal adjacent thereto overlap is a target quantity 
comprising a fixed quantity greater than 0. 

[0109] 

FIG. 28 is a block diagram showing the structure of the 
operation terminal 102 in FIG. 26 (b). The operation terminal 102 
comprises an input unit 301 that receives X T l 131TL, X T r 131TR, Y T u 
131TU, and Y T b 131TB or the position of the imaging target zone 121, 
a memory 302 that stores the position of the imaging target zone 
121 received at the input unit 301, and a communications unit 203 
that is similar to the communications unit 203 in FIG. 27 and 
transmits the position of the imaging target zone 121 recoded in 
memory 302 via a network 103. The input unit 301 is unnecessary 
where the position of the imaging target zone 121 is pre-recorded in 
memory 302. 

[0110] 

Operation of the imaging zone adjusting apparatus of the 
25 embodiment is described hereafter. The camera 201 comprising a 
component of the camera terminals 101A to 101C has an internal 
structure shown in FIG. 27. In the camera 201, an image formed by 
the lens 211 is converted to image signals at the image pickup 
surface 212. The image processor 213 detects a detection target 
30 and extracts its information in the image signals through a 

conventional image processing or image recognition technique. 
Thus, the camera 201 detects a detection target and extracts its 
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information within the detection zone comprising one's own time T 
imaging zone determined by the orientation of the lens 211 and 
image pickup surface 212 and their distance in the real space. The 
conventional image processing or image recognition technique 
5 described above includes well-known background difference 

calculus and dynamic difference calculus. The camera 201 images 
a cycle Tcycle imaging zone in a cycle Tcycle using the cycle imaging 
controller 215, which is described later. Therefore, the camera 201 
detects a detection target and extracts its information within the 
10 detection zone comprising one's own cycle Tcycle imaging zone 
determined by the cycle imaging controller 215 in the real space. 
The information of a detected detection target is sent to the 
communications unit 203. 

15 [0111] 

Further, the orientation controller 214 of the camera 201 
controls the orientation of the lens 211 and image pickup surface 
212 or the distance between the lens 211 and image pickup surface 
212 so that the time T imaging zone position of the camera 201 is 

20 moved to a time T imaging zone position based on orientation 

control signals specified by the cycle imaging controller 215. The 
orientation controller 214 obtains positional information of the time 
T imaging zone of the camera 201 determined by the orientation of 
the lens 211 and image pickup surface 212 or their distance at a 

25 time T and sends it to the cycle imaging controller 215. Thus, the 
position of the time T imaging zone of the camera 201 is controlled 
by the cycle imaging controller 215 and the positional information of 
the time T imaging zone of the camera 201 at a time T is sent to the 
cycle imaging controller 215. The calculation process of the 

30 position of the time T imaging zone of the camera 201 determined by 
the orientation of the lens 211 and image pickup surface 212 or their 
distance at a time T is described above for the imaging zone position 
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of a camera. The orientation of the lens 211 and image pickup 
surface 212 or their distance can be changed and their orientation 
and distance at a time T can be read, for example, using a stepping 
motor. 

5 

[0112] 

The cycle imaging controller 215 sends orientation control 
signals including the panning speed V P and tilting speed V T to the 
orientation controller 214 based on the time T imaging zone 

10 positional information sent from the orientation controller 214 and a 
cycle Tcycle camera panning angle 0b P and cycle T C ycle camera tilting 
angle 0b T specified by the adjusting unit A 202 according to the 
process described above for the imaging process of a cycle Tcycle 
imaging zone so that the time T imaging zone position of the camera 

15 201 is controlled and the camera 201 operates as a cycle Tcycle 

camera imaging the cycle Tcycle imaging zone. As described for the 
imaging process of a cycle Tcycle imaging zone, in addition to the 
cycle Tcycle camera panning angle 0b P and cycle Tcycle camera tilting 
angle 0b T specified by the adjusting unit A 202, a cycle T CY cle 

20 camera horizontal filed angle 0b H and cycle Tcycle camera vertical 
field angle 0b v necessary for the calculation of the imaging position 
of a cycle T C ycle imaging zone, a time T camera horizontal filed angle 
0a H and time T camera vertical field angle 0a v necessary for the 
calculation of the position of a time T imaging zone, panning speed 

25 V P const, tilting speed V t _const, and imaging interval T s are required 
to image the cycle Tcycle imaging zone. In the embodiment, the 
values are predetermined fixed values, for example, recorded in a 
memory unit, and sent to the cycle imaging controller 215. 
Alternatively, the values can be specified through the operation 

30 terminal 102. The cycle imaging controller 215 sends the positional 
information of the cycle Tcycle imaging zone of the camera 201 to the 
adjusting unit A 202. The calculation process of a cycle Tcycle 
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imaging zone position is described above for the imaging zone 
position of a camera. 

[0113] 

5 The adjusting unit A 202 periodically sends the positional 

information of the cycle T C ycle imaging zone of the camera 201 sent 
from the cycle imaging controller 215 to the adjusting unit A 202 of 
the other camera terminals via the communications unit 203 and 
network 103. Further, the adjusting unit A 202 receives the 

10 positional information of the cycle T C ycle imaging zone of the camera 
201 of the other camera terminals that is periodically sent from the 
adjusting unit A 202 of the other camera terminals. Further, the 
communications unit 203 of the operation terminal 102 periodically 
sends the positional information of the imaging target zone 121 to 

15 the adjusting unit A 202 of the camera terminals 101A to 101C via 
the network 103. 

[0114] 

Therefore, the adjusting unit A 202 of the camera terminals 
20 101A to 101C periodically obtains the positional information of the 
cycle Tcycle imaging zone of one's own camera terminal and other 
camera terminals and the positional information of the imaging 
target zone 121. In the embodiment, each adjusting unit A 202 
periodically obtains X AL 130AL, X AR 130AR, Y AU 130AU, and Y AB 
25 130AB or the position of the cycle TAcycle imaging zone 120A of the 
camera terminal 101A, X BL 130BL, X BR 130BR, Y BU 130BU, and Y BB 
130BB or the position of the cycle TB C ycle imaging zone 120B of the 
camera terminal 101B, X CL 130CL, X CR 130CR, Y cu 130CU, and Y CB 
130CB or the position of the cycle TCcycle imaging zone 120C of the 
30 camera terminal 101C, and X TL 131TL, X TR 131TR, Y TU 131TU, and 
Y TB 131TB or the position of the imaging target zone 121 via the 
communications unit 203 and network 103. 
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[0115] 

Further, the adjusting unit A 202 performs the procedure of 
the steps below and shown in FIG. 29 based on the obtained 
5 positional information of the cycle T C ycle imaging zones and imaging 
target zone 121 (which is also the positional information of the 
non-imaging zone 122). 

[0116] 

10 First, in Step 401, the cycle Tcycle imaging zone of another 

imaging zone adjacent to the cycle Tcycle imaging zone of one's own 
camera terminal or the non-imaging zone 122 is selected based on 
the positional information of the cycle Tcycle imaging zones of the 
cameras 201 of one's own camera terminal and other camera 

15 terminals. The selection process of the cycle Tcycle imaging zone of 
another camera terminal adjacent to the cycle T C ycle imaging zone of 
one's own camera terminal is described above for the adjacent 
imaging zone. When no adjacent imaging zone is found in the 
selection process described for the adjacent imaging zone, the 

20 non-imaging zone 122 is selected as the adjacent imaging zone. 

Therefore, the camera terminal 101A has, as the adjacent 
imaging zone, the non-imaging zone 122 to the left and above and 
below it and the cycle TBcycle imaging zone 120B to the right. The 
camera terminal 101B has, as the adjacent imaging zone, the cycle 

25 TAcycle imaging zone 120A to the left, the non-imaging zone 122 
above and below it, and the cycle TCcycle imaging zone 120C to the 
right. The camera terminal 101C has, as the adjacent imaging zone, 
the cycle TBcycle imaging zone 120B to the left and the non-imaging 
zone 122 above and below it and to the right. 

30 

[0117] 

Then, in Step 402, the quantity that comprising the 
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magnitude of the overlapping zone where the imaging zone selected 
in Step 401 and the imaging zone of one's own camera terminal 
overlap is calculated. This is easily calculated by comparing the 
positions of the selected imaging zone and the imaging zone of one's 
5 own camera terminal in magnitude as shown in FIG. 26 (a). 

Therefore, the following is calculated for the camera terminal 
101A: a quantity of X TL - X A l that is the magnitude of the 
non-imaging overlapping zone AL or the overlapping zone on the left, 
a quantity of X A r - X B l that is the magnitude of the non-imaging 

10 overlapping zone AB or the overlapping zone on the right, a quantity 
of Y T u - Y A u that is the magnitude of the non-imaging overlapping 
zone AU or the overlapping zone at the top, and a quantity of Y A b - 
Y T b that is the magnitude of the non-imaging overlapping zone AB or 
the overlapping zone at the bottom. The following is calculated for 

15 the camera terminal 101B: a quantity of X A r - X B l that is the 
magnitude of the non-imaging overlapping zone AB or the 
overlapping zone on the left, a quantity of X B r - X C l that is the 
magnitude of the non-imaging overlapping zone BC or the 
overlapping zone on the right, a quantity of Y T u - Y B u that is the 

20 magnitude of the non-imaging overlapping zone BU or the 

overlapping zone at the top, and a quantity of Y BB - Y TB that is the 
magnitude of the non-imaging overlapping zone BB or the 
overlapping zone at the bottom. The following is calculated for the 
camera terminal 101C: a quantity of X BR - X CL that is the magnitude 

25 of the non-imaging overlapping zone BC or the overlapping zone on 
the left, a quantity of X C r - X T r that is the magnitude of the 
non-imaging overlapping zone CR or the overlapping zone on the 
right, a quantity of Y T u - Y C u that is the magnitude of the 
non-imaging overlapping zone CR or the overlapping zone at the top, 

30 and a quantity of Y CB - Y TB that is the magnitude of the non-imaging 
overlapping zone CB or the overlapping zone at the bottom. 
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Then, in Step 403, the imaging zone position of one's own 
camera terminal is adjusted so that the quantities that indicate the 
magnitudes of the overlapping zones calculated in Step 402 
5 converge on a fixed quantity Coverlap- The adjustment process is 
described hereafter. First, a function FA () yielding a quantity 
indicating the difference between the quantity indicating the 
magnitude of an overlapping zone and 0 or a fixed quantity Coverlap 
equal to or greater than 0 is selected. In the embodiment, this 
10 function is presented by the expressions 34 to 36. 



[0119] 
[Math 34] 
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...(Formula 34) 



[0120] 
[Math 35] 
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FA BL (X BL ) = {X 
FA BR (X m ) = {X 
FA BU (Y BU ) = (7 3 
FA BB {Y = 
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[0121] 
[Math 36] 



FA CL (X CL ) = {X BR — X CL — Cq^xj^p ) 

F-dcR i^-CR ) = C^CT? *" X TR — C OVERLAP ) 

F^cu i-^cu ) = (Xtu " Y cu — C omRLAP ) 

FdcB facB ) = (XcB ~ ^TB ~~ ^"OVERUkP ) 



.(Formula 36) 



The expressions 34 to 36 correspond to the camera terminals 
101A to 101C, respectively, raising the difference between the 
quantity indicating the magnitude of an overlapping zone and a fixed 
quantity Coverlap to the second power to yield a quantity indicating 
the individual difference. Then, the position of the next imaging 
zone of one's own camera terminal is calculated by the generally 
known steepest descent method as presented by the expressions 37 
to 39. 
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[0122] 
[Math 37] 
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[0123] 
[Math 38] 



...(Formula 37) 
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...(Formula 38) 

[0124] 
5 [Math 39] 




...(Formula 39) 
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In the expressions 37 to 39, X' AL , X' AR/ Y' AU , Y'ab, X'bl, X' B r, 
Y'bu/ Y'bb, X'cl/ X'cr, Y'au/ Y' C b comprise the positions of the next 
5 cycle TAcycle imaging zone 120A to next cycle TCcycle imaging zone 
120C of the camera terminals and a is a constant. Finally, the 
positions of the cycle Tcycle imaging zones of the camera terminals 
101A to 101C are adjusted for the cycle Tcycle imaging zone 
positions. In the process above, X A l 130AL, X AR 130AR, X AU 130AU, 

10 and X AB 130AB for the position of the cycle TAcycle imaging zone 

120A of the camera terminal 101A should be adjusted independently. 
The same is true for the camera terminals 101B and 101C. When 
they cannot be adjusted independently, a function that linearly adds 
the function FA of the elements that comprise not adjusted 

15 independently is defined and this function is subject to the steepest 
descent method. For example, in the camera 201 of the 
embodiment, the cycle Tcycle camera horizontal and vertical field 
angles 0b H and 0b v are fixed. Therefore, X AL 130AL and X AR 130AR 
cannot be adjusted independently and X AU 130AU and X AB 130AB 

20 cannot be adjusted independently, either. However, a function G () 
presented by the expression 40 to 42 can be selected and subject to 
the steepest descent method presented by the expressions 43 to 45 
to conduct the similar adjustment to that described above. In the 
expressions above, 0b PA and 0b T A, 0b PB and 0b T B, and 0b PC and 0b T c 

25 comprise the cycle Tcycle camera panning and tilting angles of the 
camera terminals 101A to 101C, respectively. 

[0125] 
[Math 40] 

30 
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) = FA A {X M ) + ^ ) 4 ) + FA AB (Y M )} 

X AL ~ G AA eb PA^ 6b T^) 
X AR ~ G AR {®>PA » 0b TA ) 
Y AU "GaU^PA^Ta) 
Y AB= G Aa( Gb PA^ b TA) 

( X TL - G AL (& b PA > ®>TA ) ~ G OVERLAP Y + ( G Afl ( 0b PA » 0b TA )~ X BL~ G OI>ERLAP Y + 
On/ - G Au(&rA>^rA)- C OrEPJji?Y +( G A!}(0 b PA>0 b TA)' Y T3 ~ ^OVERLAP Y 



...(Formula 40) 

5 [0126] 
[Math 41] 

FA^X BL> X Mm. ( x bl ) + FA BR (X BR ) + (y w )+ FA BB {Y B3 )] 

■^/rt = G ai. (& b PB > ^ra ) ! 

X BR ~ G BR (@ b PB • @>78 ) 
JflU =G m)(^ 3 PB^ b TB) 
Y BB = G BB (®>PB >Q b TB ) 

FA a (X BL ,X BK ,Y BU ,Y u ) = FA B (6b PBt Cb JB ) = 

( X AR~ G BL i 0b PB > 6b T3 )~ ^OVERLAP Y + fc* > )- ^Ct - ^OVERLAP Y + 

fe/ > ) _ G oy£Aur Y + ( G m (^a > # 6 7» ) ~ y tb ~ c overlap Y 

...(Formula 41) 

10 

[0127] 
[Math 42] 



-79- 



y a )'^{X a )+FA a Xx ai )+ FA cu (Y ctJ ) y F/J CB (y CB )] 

>^ =G cy («»«-,«» rc ) 

FA C {X CL , X cn ,Y cu , y„ ) = FA c {6b K , 6b-^ m 

[ X sn ~ ^CL fare » ^jc ) - ^oveklap Y + (^cj? (^/c • ^tc ) ~ *V.? - Connie )* + 
(/yt, -G cu fa K ,0h JJ -)-C avEFJAf ,y J r(Gcsfarc>GbTc)-~ jr 7B -Comaj&f 



...(Formula 42) 



[0128] 
[Math 43] 



) = Ma. (* a ) + FA cn (*cn ) + ™cu Pa* ) + ^ ) 



Y cn ~ G cg {Gbpr , 8b ix: ) 

FA C Wet > X CR > ¥ Ctt > Y CB ) ~ FA C i&bpc , ) = 

(^»/f _ G ci {Gbf-c > )~ Co what ) + ( G at[^ , fc^ } Tc)~ x rn -CovsnurY + 
[Yru- G cu (Gb PC , ) - C airERLAP ) 2 + (G ca (0b PC , )- Y m - C OVERLAP f 
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[Math 44] 
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[0130] 
[Math 45] 
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The adjusting unit A 202 performs the procedures of Steps 
10 401, 402, and 403 in sequence and returns to Step 401 after 

completing the procedure of Step 403. Constantly repeating the 
procedures of Steps 401 to 403, the adjusting unit A 202 sends 
updated values of the cycle T C ycle camera panning angle ©d'pa (or 
©b'pB or ©b'pc) and cycle T C ycle camera tilting angle ©d'ta (or ©d'tb or 
15 ©d'tc) calculated by the expressions above to the cycle imaging 
controller 215 so that the position of the cycle T C ycle imaging zone of 
the camera 201 is adjusted. 



[0131] 

20 The operation of the imaging zone adjusting apparatus of the 
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embodiment is as described above. In Step 403, the position of the 
next cycle T C ycle imaging zone of one's own camera terminal is 
calculated using the steepest descent method in which the quantity 
indicating the magnitude of the overlapping zone converges on 0 or 
5 a fixed quantity Coverlap equal to or greater than 0 and the cycle 
Tcycle imaging zone position of the camera 201 is adjusted for the 
next cycle Tcycle imaging zone position. Then, with the procedures 
of Steps 401 to 403 being repeated, the cycle TAcycle imaging zone 
120A, cycle TBcycle imaging zone 120B, and cycle TCcycle imaging 

io zone 120C, or the cycle Tcycle imaging zones of the camera terminals 
101A to 101C, and the non-imaging zone 122 overlap by a fixed 
quantity of 0 or a fixed quantity Coverlap equal to or greater than 0. 
As shown in FIG. 26, when the cycle Tcycle imaging zones of the 
camera terminals and the non-imaging zone 122 overlap by a fixed 

15 quantity of 0 or a fixed quantity Coverlap equal to or greater than 0, 
the imaging target zone 121 is contained in a combined zone of the 
cycle Tcycle imaging zones of the camera terminals. Hence, the 
imaging zone adjusting apparatus of the present invention allows 
the camera terminals 101A to 101C to image the imaging target 

20 zone 121 with no blind spots. 

[0132] 

With the adjusting unit A 202 repeating the procedures of 
Steps 401 to 403, the effect that the imaging target zone 121 is 
25 imaged with no blind spots is obtained. The procedures of Steps 
402 and 403 are repeated for the cycle T C ycle imaging zone of 
another camera adjacent to the Tcycle imaging zone of one's own 
camera terminal and selected In Step 401 and for the non-imaging 
zone 122. 

30 

[0133] 

Therefore, even if any change occurs in the position of the 
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cycle Tcycle imaging zone of another camera adjacent to the Tcycle 
imaging zone of one's own camera terminal or in the position of the 
non-imaging zone 122 (which is also the position of the imaging 
target zone 121) at each time point, the effect that the imaging 
5 target zone 121 is imaged with no blind spots can be obtained in 
accordance with the change. The position of the cycle Tcycle 
imaging zone or imaging target zone 121 can be changed when: 

(1) the cycle Tcycle imaging zone of a camera terminal is 
intentionally changed; 

(2) an additional camera terminal is installed; 

(3) some of the camera terminals are removed or unserviceable; or 

(4) the imaging target zone position sent from the operation 
terminal is changed. The operation of the present invention in 
response to the situational changes is described in Embodiments 6 
and 7, described later. Even if the cycle T C ycle imaging zone 
position sent from each camera terminal or the imaging target zone 
position sent from the operation terminal is changed or not sent, or 
a new cycle Tcycle imaging zone position is sent according to the 
changes, the imaging zone adjusting apparatus of the present 
invention allows the camera terminals to image the imaging target 
zone with no blind spots in accordance with changes in the cycle 
Tcycle imaging zone position or imaging target zone position. 

25 [0134] 

In the embodiment, the function FA () presenting the 
difference between a quantity indicating the magnitude of the 
overlapping zone and 0 or a fixed quantity Coverlap equal to or 
greater than 0 is a function raising the difference between a quantity 
30 indicating the magnitude of the overlapping zone and a fixed 
quantity Coverlap to the second power as presented by the 
expressions 34 to 36 or the expressions 40 to 42. However, as 
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shown in FIG, 30, the function FA () can be a function raising the 
difference between a quantity indicating the magnitude of the 
overlapping zone and a fixed quantity Coverlap to an even-numbered 
power such as the fourth, sixth, and tenth power or a function 
5 yielding the absolute value of the difference between a quantity 
indicating the magnitude of the overlapping zone and a fixed 
quantity Coverlap- The functions have the minimum values when X A l 
- Xjl = Coverlap and a quantity indicating the magnitude of the 
overlapping zone converges on a fixed quantity Coverlap in the 
10 steepest descent method In Step 403. Needless to say, the same 
effect can be obtained. 

[0135] 

The same effect can be obtained even if the function FA () 
15 presenting the difference between a quantity indicating the 

magnitude of the overlapping zone and 0 or a fixed quantity Coverlap 
equal to or greater than 0 has a minimal value, not the minimum 
value, when X A l - X T l = Coverlap as shown in FIG. 31 as long as the 
function FA () has the minimum value when X A l - X T l = Coverlap 
20 within a range over which X A l - X T l is changed. 

[0136] 

The magnitude of the overlapping zone has a target value of 
0 or a fixed quantity Coverlap equal to or greater than 0. The fixed 

25 quantity Coverlap is preferably greater than 0 because it is ensured 
that the hypothetical imaging zones (the cycle T C ycle imaging zones 
in the embodiment) overlap, and do not simply abut. Then, the 
imaging target zone can be completely imaged in a more reliable 
manner and, as described later, images of the hypothetical imaging 

30 zones (the cycle T C ycle imaging zones in the embodiment) can be 
easily merged (put together) into an image. 
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[0137] 

In the embodiment, as shown in FIG. 27, the adjusting unit A 
202 is distributed at each camera terminal 101A to 101C. Needless 
to say, the same effect can be obtained where only one adjusting 
5 unit A 202 is present and the only one adjusting unit A 202 controls 
the cycle T C ycle imaging zone positions of the cameras of the camera 
terminals 101A to 101C. 

[0138] 

io In the embodiment, the network 103 is a network line used 

for general communication. Needless to say, the same effect can 
be obtained regardless of that the network 103 is a wired or wireless 
network. 

15 [0139] 

In the embodiment, the magnitudes of the overlapping zones 
on the right and left and at the top and bottom are adjusted to a 
common fixed quantity Coverlap. However, the same effect can be 
obtained even if they are adjusted to different fixed quantities 
20 Coverlap on the right and left and at the top and bottom, furthermore, 
to different fixed quantities Coverlap in the camera terminals 101A to 
101C as long as each fixed quantity Coverlap is 0 or equal to or 
greater than 0. 

25 [0140] 

In the embodiment, the cycle T C ycle camera panning and 
tilting angles 0b P and 0b T are adjusted and updated by the adjusting 
unit A 202 and the cycle Tcycle camera horizontal and vertical field 
angles 0b H and 0b v are fixed values. However, the cycle Tcycle 
30 camera imaging zone position is changed according to the cycle 
Tcycle camera horizontal and vertical field angles ©b H and 0b v . 
Needless to say, the same effect can be obtained where the cycle 

-85- 



Tcycle camera panning and tilting angles 0b P and 0b T are fixed 
values and a similar unit to the adjusting unit A 202 is provided for 
the cycle Tcycle camera horizontal and vertical field angles 0b H and 
0b v to adjust and update them as presented by the expression 46. 
5 Similarly, the same is true for the time T camera horizontal and 
vertical field angles 0a H and 0a v , panning and tilting speeds V P const 
and V t _const, and imaging time period T s besides the cycle Tcycle 
camera horizontal and vertical field angles 0b H and 0bv. 

10 [0141] 
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[Math 46] 



X AL= G AL( Gh HA> eh VA) 
X AR= G AR{9 b HA> 0h VA) 
Y AU = G Au(& b HA>& b VA) 

yAB=G AB (0b HA ,9b l/A ) 
FA A {X^X AR J AU J AB ) = FA A {0b HA ,0b yA ) = 

{X TL ~ G AL (& b HA ' GbvA ) ~ G 0\HRLAP ) + 

( g aji (@ b nA s & b vA ) ~ x BJ - c 0]/ERLAP y + 

(Y TU —G AU {pb HA ,0b VA )—C O]/ERLAP ^ + 

{ G AB {@ b HA ' @ b VA ) ~~ Y TB — G OVERLAP ) 

nh' -ah dFA A {Obyj A > @b VA ) 
fx* ha ~ ha ~ a rr7 

oUb VA 

...(Formula 46) 

5 Needless to say, the same effect can be obtained where the 

cycle Tcycle camera panning and tilting angles 0b P and 0b T are 
adjusted and updated by the adjusting unit A 202 and the cycle 
Tcycle camera horizontal and vertical field angles ©b H and 0b v are 
adjusted and updated by an adjusting unit similar to the adjusting 
10 unit A 202 using the expression 47, respectively. 

Similarly, the same is true for the time T camera horizontal 
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and vertical field angles 0aH and 0av, panning and tilting speeds 
V p _const and V T C onst/ and imaging time period T s besides the cycle 
Tcycle camera horizontal and vertical field angles 0b H and 0b v . 

5 [0142] 
[Math 47] 



G AR {eb PAi eb TA ,Qb HAi 6b VA ) 

Yab = 



Y AU = G AU i 6b PA > 0b TA > & HA » &>M ) 

Y AB = (66 PA , 6b TA , 9b HA , 0b VA ) 

Yau>Yab) = FA A {eb FAi 9b TA7 6b m ,0b VA ) - 

(X TL - (06^ s ^ , 06^ , 6b M ) - C olf£R1J[p )' + 

(G Afl (&b PA , Bb TA , 6b HA , 6b VA )-X BL - G 0]/ERLAP )" -f 
( v _rz (oh ah au pu \—r Vj. 



+ 

b HA ' 6b VA ) — — G 0]/ERLAP ) 
On/ ~ ^t; {6b PA , , , Qb VA ) - C 0VElUAP J h 

C^B ' fl^W » > ^>K4 ) ~ 5 73 _ C OVERLAP Y 

& ^ 0h dFA A {9b PA M TA ,9b HA ,0b VA ) 

PA PA d&b PA 

ffn -Oh d™Ato PA .to TA ,0b HA ,0by A ) 
ffo TA -0b TA -a _ 

Ob\^Bb HA _ a ^ A {0b PA ,0b TA ^mJ 

Ob' ^ G b a dFA ^ 6b ^ eb ^ eb HA^b V A ) 
YA VA r\f)h... 



...(Formula 47) 

10 [0143] 

(Embodiment 2) 

Embodiment 2 of the present invention is described hereafter. 
In the embodiment, an imaging zone adjusting apparatus in which 
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the cycle T C ycle imaging zones of the cameras of the camera 
terminals are self-adjusted so that a combined zone of the cycle 
Tcycle imaging zones of the cameras of the camera terminals 
completely covers a specific imaging target zone and the imaging 
5 cycles Tcycle of the cameras of the camera terminals are 

self-adjusted to be equal is described with reference to FIGS. 32 to 
33. 

[0144] 

First, advantages of the imaging cycles Tcycle of the cameras 
of the camera terminals being equal are described. The imaging 
zone adjusting apparatus described in Embodiment 1 above allows 
the imaging zones of the cameras of the camera terminals to cover 
a specific imaging target zone with no blind spots. This does not 
mean that the imaging cycles Tcycle of the cameras of the camera 
terminals are equal. When the imaging cycles Tcycle of the cameras 
of the camera terminals are not equal, for example when a specific 
camera terminal has a significantly large imaging cycle Tcycle, the 
update of images of a cycle Tcycle imaging zone imaged by that 
camera terminal is delayed and it takes more time to find a detection 
target within that cycle Tcycle imaging zone. This is problematic 
when the imaging zone adjusting apparatus of the present invention 
is used for surveillance. Therefore, it is desired that the imaging 
cycles Tcycle of the cameras of the camera terminals are not 
different, but nearly equal. 

[0145] 

Components of the imaging zone adjusting apparatus of the 
embodiment are described hereafter. FIG. 32 is a block diagram 
30 showing the structure of a camera 201 in the embodiment, which 
corresponds to the camera terminals 101A to 101C in FIG. 26 (a). 
The camera terminals 101A to 101C each comprise at least a camera 
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201, an adjusting unit A 202, a communications unit 203, and a 
cycle field angle adjusting unit A 204. The camera 201 comprises a 
lens 211, an image pickup surface 212, an image processor 213, an 
orientation controller 214, and a cycle imaging controller 215. The 
5 camera 201, adjusting unit A 202, communications unit 203, lens 
211, image pickup surface 212, image processor 213, orientation 
controller 214, and cycle imaging controller 215 in FIG. 32 are the 
same as those in the block diagram showing the structure of the 
camera terminals 101A to 101C of Embodiment 1 in FIG. 27. In the 

10 block diagram showing the structure of the camera terminals 101A 
to 101C of the embodiment in FIG. 32, the cycle T C ycle camera 
horizontal and vertical field angles Ob H and 0b v are not fixed values. 
The cycle field angle adjusting unit A 204 comprising a processor to 
adjust and output the field angles of the cycle T C ycle imaging zone of 

15 the camera 201 is added. 

[0146] 

This is the only difference in components between 
Embodiment 1 and the embodiment. The imaging zone adjusting 
20 apparatus has the same structure as that in FIG. 26 (a), the imaging 
zone positions on the real space plane 113 of the imaging zone 
adjusting apparatus are the same as those in FIG. 26 (b), and the 
operation terminal 102 has the same structure as that in FIG. 28. 

25 [0147] 

With the addition of the cycle field angle adjusting unit A 204, 
in the embodiment, the adjusting unit A 202 and cycle field angle 
adjusting unit A 204 adjust the position and imaging cycle of the 
hypothetical imaging zone (the cycle T C ycle imaging zone in the 
30 embodiment) of one's own camera terminal so that the imaging 

cycle of the hypothetical imaging zone (the cycle T C ycle imaging zone 
in the embodiment) of one's own camera terminal and the imaging 
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cycles of hypothetical imaging zones (the cycle Tcycle imaging zones 
in the embodiment) adjacent thereto are nearly equal in addition to 
the adjustment of Embodiment 1. 

[0148] 

Operation of the imaging zone adjusting apparatus of the 
embodiment is described hereafter. The cycle field angle adjusting 
unit A 204 is the only additional unit in the embodiment compared to 
Embodiment 1. The cycle field angle adjusting unit A 204 sends the 
cycle Tcycle camera horizontal and vertical field angles 0b H and 0b v 
to the cycle imaging controller 215. Needless to say, the 
embodiment has all effects described for Embodiment 1. In other 
words, the imaging zones of the cameras of the camera terminals 
are self-adjusted so that a combined zone of the imaging zones of 
the cameras of the camera terminals completely covers a specific 
imaging target zone. 

[0149] 

The field angle adjusting unit A 204 periodically sends field 
20 angle information of the cycle T CY cle imaging zone of the camera 201 
to the field angle adjusting unit A 204 of the other camera terminals 
via the communications unit 203 and network 103. Further, the 
field angle adjusting unit A 204 receives the field angle information 
of the cycle Tcycle imaging zone of the camera 201 of the other 
25 camera terminals that is periodically sent from the field angle 

adjusting unit A 204 of the other camera terminals. Therefore, the 
field angle adjusting unit A 204 of the camera terminals 101A to 
101C periodically receives the field angle information of the cycle 
Tcycle imaging zone of the camera 201 of one's own camera terminal 
30 and other camera terminals. In the embodiment, each field angle 
adjusting unit A 204 periodically obtains field angles 0b H A and 0b VA 
(horizontal and vertical field angles, respectively) of the cycle 
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TAcycle imaging zone 120A of the camera terminal 101A, field angles 
©Dhb and 0b V B of the cycle TB C ycle imaging zone 120B of the camera 
terminal 101B, and field angles Ob H c and 0b V c of the cycle TCcycle 
imaging zone 120C of the camera terminal 101C via the 
5 communications unit 203 and network 103. 

[0150] 

Then, the field angle adjusting unit A 204 performs the 
procedures of the steps below and shown in FIG. 33 based on the 
10 obtained field angle information of the cycle T C ycle imaging zones 
described above. 

[0151] 

First, in Step 801, a cycle T C ycle imaging zone of another 
15 camera terminal adjacent to the cycle Tcycle imaging zone of one's 
own camera terminal is selected. This process is explained for 
Embodiment 1 and, therefore, not described here. The process is 
also performed by the adjusting unit A 202 and the processing result 
of Step 401 performed by the adjusting unit A 202 can be used. 
20 However, the adjusting unit A 202 may select the non-imaging zone 
122. Therefore, when the non-imaging zone 122 is selected, it is 
assumed that there is no adjacent cycle Tcycle imaging zone of 
another camera terminal. 

25 [0152] 

Then, in Step 802, quantities indicating the differences in 
field angle between the imaging zone selected In Step 801 and the 
imaging zone of one's own camera terminal are calculated. To do so, 
quantities 0b H B - ®b H A and 0b V B - 0b V A indicating the differences in 
30 field angle from the cycle TBcycle imaging zone 120B or the imaging 
zone on the right are calculated for the camera terminal 101A, 
quantities 0b HA - ©b H B and 0b V A - 0b V B indicating the differences in 
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field angle from the cycle TA C ycle imaging zone 120A or the imaging 
zone on the left and quantities 0b H c - ©d H b and ©b V c - 0d V b 
indicating the differences in field angle from the cycle TCcycle 
imaging zone 120C or the imaging zone on the right are calculated 
5 for the camera terminal 101B, and quantities 0d H b - ©b H c and ©b V B 
- 0bvc indicating the differences in field angle from the cycle TBcycle 
imaging zone 120B or the imaging zone on the left are calculated for 
the camera terminal 101C. 

10 [0153] 

Then, in Step 803, the field angles of the imaging zone of 
one's own camera terminal are adjusted so that the quantities 
indicating the differences in field angle and calculated In Step 802 
converge on 0. The adjustment process is described below. First, 
15 a function FB () presenting a quantity indicating the difference in 
field angle is selected. In the embodiment, the function is 
presented by the expressions 48 to 50 (the function FB () = 0 for the 
direction in which there is no adjacent imaging zone). 

20 [0154] 
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t 



[Math 48] 



FB Aly (6b ffA ) = 0 
FB A!lH (eb IJA ) = {6b HB -8b m ) 2 

FB AU „{0b HA ) = O 
FB AUi ,(Ob yA ) = 0 
FB ABH (6b HA ) = Q 
FB ABi/ (0b l , A ) = O 

FB AM &>ha ) = FBmm iOb }iA ) + FBjjw (0b HA ) + FB AUH {6b HA ) + FB ABH (Ob„ A ) 
FB AV (6b yA ) = FB ALV (6b VA ) + FB AW (% va ) + FB AW (6b VA ) + FB ABV {Gb VA ) J 



..(Formula 48) 



5 [0155] 
[Math 49] 



FB aUi (0b m ) = {0b JIA -Ob HB ) 7 

FB BRH {0b Ha ) = {0b HC -0b HB f 

FB BUH (eb HB )^Q 
FB suy (Ob yB ) = 0 
FB BBH {6b HB ) = Q 
FB Bny (6b VB ) = 0 

FB m (0b m ) « FB BLH (Ob m ) + FB Bm ( 0b HB ) + FB BU)1 {6b m )+ FB EQli (6b HB ) < 
-F-#it;' (^i<b ) = FB BU . (Qb^ ) + FBxpj, {6b m ) + FB BUV (6b t/B ) + FB BBV {6b m ) j 



.(Formula 49) 
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[0156] 
[Math 50] 



^B CLH (9b HC ) = (6b H3 -Gb HC f 

FB cnM {0b }}C ) = O 
FB ca y(O> vc ) = 0 
™ cu „(0b HC ) = O 
FB cuy (Gb yc ) = 0 
FB CBH {6b HC ) = Q 
FB CBi ,(0b yc ) = O 

FB CH (0b HC )= FB CL „{6b HC )^FB cm {6b HC )+FB CUH {eb HC )+FB^ H {Gb yic ) 
FB CV (flfc ) = FB CLV (% r ) r FB CRV {Obyc ) -f FB CU( , (% c ) + FB CBV (0b, v ) J 

5 ...(Formula 50) 

The expressions 48 to 50 correspond to the camera terminals 
101A to 101C, respectively, raising a quantity indicating the 
difference in field angle to the second power to yield a quantity 
indicating the individual difference. Then, the generally known 

10 steepest descent method is used as presented by the expressions 51 
to 53 to calculate the field angles of the next imaging zone of one's 
own camera terminal. In the expressions 51 to 53, 0d' H a, ©b' VA , 
©d'hb, ©b'vB, ©b' H c, and ©b'vc comprise the field angles of the next 
cycle TAcycle imaging zone 120A to cycle TCcycle imaging zone 120C 

15 of the camera terminals, respectively, and a is a constant. Finally, 
the field angles of the cycle T C ycle imaging zones of the camera 
terminals 101A to 101C are adjusted for the field angles of the cycle 
Tcycle imaging zones, respectively. 

20 [0157] 

[Math 51] 
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dFB AH (6b HA ) 



HA 



d6b 



HA 



9b VA = 6b„ A - a 



VA 



dFB Ay {6b yA ) 
d6b„ A 



...(Formula 51) 



5 [0158] 
[Math 52] 



0b HB = 0b uo - a 



dFB BH (eb„ B ) 



HB 



ddb 



dbyg = 6b, m - a 



dFB BV (ob, m ) 



VB 



dOb 



.(Formula 52) 
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[0159] 
[Math 53] 




5 

...(Formula 53) 
The cycle field angle adjusting unit A 204 performs the 
procedures of Steps 801, 802, and 803 in sequence and returns to 
the procedure of Step 801 after completing the procedure of Step 

10 803. Constantly repeating the procedures of Steps 801 to 803, the 
cycle field angle adjusting unit A 204 sends updated values of the 
cycle Tcycle camera horizontal and vertical field angles 0b' H and 0b'v 
calculated by the expressions above to the cycle imaging controller 
215 so that the field angles of the cycle T C ycle imaging zone of the 

15 camera 201 are adjusted. 

[0160] 

The operation of the imaging zone adjusting apparatus of the 
embodiment is as described above. In Step 803, the field angles of 

20 the next cycle Tcycle imaging zone of one's own camera terminal are 
calculated using the steepest descent method in which the 
quantities indicating the differences in field angle converge of 0 and 
the field angles of the cycle T C ycle imaging zone of the camera 201 
are adjusted for the field angles of the next cycle Tcycle imaging zone. 

25 Therefore, with the procedures of Steps 801 to 803 being repeated, 
the field angles of the cycle TA C ycle imaging zone 120A, cycle TB C ycle 
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imaging zone 120B, and cycle TCcycle imaging zone 120C, or the 
cycle Tcycle imaging zones of the camera terminals 101A to 101C, 
become equal to one another. In other words, in addition to the 
adjustment of Embodiment 1, the position and imaging cycle of the 
5 hypothetical imaging zone (the cycle Tcycle imaging zone in the 
embodiment) of one's own camera terminal is adjusted so that the 
imaging cycle of the hypothetical imaging zone (the cycle Tcycle 
imaging zone in the embodiment) of one's own camera terminal and 
the imaging cycles of the hypothetical imaging zones (the cycle 
10 Tcycle imaging zones in the embodiment) adjacent thereto are 
nearly equal. 

[0161] 

With the camera terminals 101A to 101C, when the field 
15 angles of the cycle Tcycle imaging zones are equal and the panning 
and tilting speeds V P const and V t _const at which the orientation of 
the camera 201 is changed and the horizontal and vertical field 
angles 0a H and 0a v of the camera 201 that determine the size of the 
time T imaging zone are equal, the imaging cycles Tcycle of the 
20 camera terminals 101A to 101C are equal according to the 

explanation of the imaging process of a cycle Tcycle imaging zone. 
In the embodiment, the panning and tilting speeds V P C onst and 
V T const and the horizontal and vertical field angles 0a H and 0a v are 
predetermined fixed values. The values can be set for the same 
25 value with the camera terminals 101A to 101C. Then, according to 
the operation of the embodiment described above, the imaging 
cycles Tcycle of the camera terminals 101A to 101C can be equal. 

[0162] 

30 In the explanation of the above operation, the camera 

terminals 101A to 101C have the same panning and tilting speeds 
Vp_const and V t _const and horizontal and vertical field angles 0a H and 
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0a v . When the values cannot be the same because of restrictions in 
mechanical performance of the camera terminals 101A to 101C, the 
imaging cycles T C ycle of the camera terminals 101A to 101C can be 
made equal by the process below. 



According to the explanation of the imaging process of a cycle 
Tcycle imaging zone, the imaging cycle T CY cle of the cycle T C ycle 
imaging zone can be calculated by an approximate expression 

10 presented by the expression 54. Then, the calculation In Step 802 
is executed by the expressions 55 to 57 and the calculation In Step 
803 is executed by the expressions 58 to 60 (here, the horizontal 
and vertical cycle Tcycle imaging zone sizes Lb H and Lb v and the 
horizontal and vertical time T imaging zone sizes La H and ab v are 

15 functions of the field angles 0b H and 0bv of the cycle Tcycle imaging 
zone and the field angles 0a H and 0a v of the time T imaging zone, 
respectively). 



5 



[0163] 



[0164] 
20 [Math 54] 



T, 



Lb 



H 



X 

x T s La v x V y 



Lb v 



CYCLE 



La^ x V, 



xT s 



P CONST 



V CONST 



...(Formula 54) 



[0165] 



25 
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[Math 55] 



CYCLE B 1 CYCLE A 



y 



FB Al( T CYCL£_a)^ 0 

WcYCLE_a) = 

^/ti (^CXQLf _a) + -^iM C^CyCLf ^ )+ FB AU (?CYCU-_a) + FB AB ( T C 



CYCLE A; 



5 [0166] 
[Math 56] 



.(Formula 55) 



(^CfCL£_*) ~ [^CTCLt'^A ~~ ^ CYCLE _B ^ 

FBbW cycle _a) 



...(Formula 56) 



10 [0167] 

[Math 57] 
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F^CR 0 CYCLE _C ) — 0 

FB cb( T cycle _c) = 0 

^cL(W.c)+^ Cfl (r c , Ci£ C )+/^ ct/ (r cya£ c )+Fj8 e ,(7 , CTae c ) 



...(Formula 57) 

[0168] 
5 [Math 58] 



- 101 - 



6b 



HA 



HA 



V, 



P CONST A 



V, 



T CONST A 



Ob 



HA 



a 



Ob VA = 9b„ A - a 



VA 



6a' A = dciu* - 



3fb a ir CYCLEA ) 

dFB AV CYCLE _A) 

dFB A {T c 



VA 

CYCLE A 



) 



HA 



6a VA = 6a„ A - a 



d6a 
dFB A (T ( 



HA 
CYCLE A 



) 



VA 



dOa 



P CONST A 



— a 



( \ 

dFB AV CYCLE A) 



T CONST A 



-a 



dV 

P .CONST _ A 
dFB AV CYCLE _A ) 



T = 

1 SA 



dV 

T _Cl 

dFB AV CYCLE A) 



ONST A 



SA 



.(Formula 58) 
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[Math 59] 



db HB = Ob 



P CONST B 



V' 



CONST B 



HB 



a 



dFB B {r cYCLE B ) 



6b in3 = 9b 1/n - a 



86b 
dFB B {T cyi 



HB 
CLE B 



) 



Od HB = Oa un - a 



dOb m 

OFB B YcYCLE_B J 



HB 



9a VB — Qa„ a — a 



d6a HB 
&FBb ^Fcycle_b ) 



VB 



80a 



P CONST b 



a 



( ) 

dFBsV CYCLE BJ 



T CONST B 



-a 



dFB B \T c 



P , CONST _B 
CYCLE B 



) 



T = 

J SB 



dV T q- 

BICYCLE b) 



ONST B 



dZ 



SB 



.(Formula 59) 



5 [0170] 
[Math 60] 
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9b HC = Qhur — 



HC 



a 



dFBc^FcYCLE c) 



30b 



0b vc — 6bur> — a 



P CONST C 



T CONST C 



dF^CVCYCLE c) 



VC 



Qq HQ = 0a. — (X 



d6b 
3FB C 



VC 

CYCLE C 



) 



HC 



9a vc = 0a vr . - a 



80a 
dFB c {T c 



HC 
CYCLE C 



) 



VC 



dOa 



CONST C a 



^T CONST c a 



dFBc V CYCLE c) 



PJCONST c 



dFB c {r CYCLE c ) 



*sc ~ 



T sc -a 



, - r T_CO. 

dFB c y CYCLE _C ) 



T CONST C 



sc 



...(Formula 60) 

With the cycle field angle adjusting unit A 204 repeating the 
procedures of Steps 801 to 803, the effect that the imaging cycle 
Tcycle is made equal is obtained. The procedures of Steps 802 and 
803 are repeated for the cycle Tcycle imaging zone of another 
camera adjacent to the cycle T C ycle imaging zone of one's own 
camera terminal selected In Step 801. 

[0171] 
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Therefore, even if any change occurs in the field angles of the 
cycle Tcycle imaging zone of another camera adjacent to the cycle 
Tcycle imaging zone of one's own camera terminal (and the panning 
and tilting speeds V P const and V t _const, imaging interval T s , and 
5 field angles of the time T imaging zone) at each time point, the 
effect that the imaging cycle Tcycle is made equal can be obtained in 
accordance with the change. The imaging cycle Tcycle of the cycle 
Tcycle imaging zone described above may be changed when: 

10 (1) the field angles of the cycle Tcycle imaging zone (and the panning 
and tilting speeds V P C onst and V t _const, imaging interval T S/ and 
field angles of the time T imaging zone) of a camera terminal is 
intentionally changed; 

(2) an additional camera terminal is installed; or 
15 (3) some of the camera terminals are removed or unserviceable. 
The operation of the present invention in response to the situational 
changes is described in Embodiments 6 and 7, described later. 
Even if the cycle Tcycle imaging zone field angles sent from the 
camera terminals are changed or not sent or new cycle Tcycle 
20 imaging zone fields angles are sent according to the changes, the 
imaging zone adjusting apparatus of the present invention allows 
the camera terminals to have an equal imaging cycle Tcycle in 
accordance with changes in field angle of the cycle T C ycle imaging 
zones. 

25 

[0172] 

In the embodiment, the function FB () presenting the 
difference in field angle and the difference in imaging cycle Tcycle is 
a function raising the difference in field angle or the difference in 
30 imaging cycle Tcycle to the second power as presented by the 
expressions 48 to 50 and the expressions 55 to 57. As in 
Embodiment 1, the function FB () can raise the difference in field 
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angle or the difference in imaging cycle Tcycle to an even-numbered 
power such as the fourth, sixth, and tenth power. The function FB 
() can also yield the absolute value of the difference in field angle or 
the difference in imaging cycle Tcycle- The functions FB () have the 
5 minimum value when the difference in field angle or the difference in 
imaging cycle T C ycle is 0. Therefore, the steepest descent method 
In Step 803 leads the difference in field angle or the difference in 
imaging cycle Tcycle to 0, whereby the same effect can be obtained. 

[0173] 

Needless to say, as in Embodiment 1, the same effect can be 
obtained even if the function FB () presenting the difference in field 
angle or the difference in imaging cycle Tcycle has a minimal value, 
not the minimum value, when the difference in field angle or the 
difference in imaging cycle Tcycle is 0 as long as the function FB () 
has the minimum value when the difference in field angle or the 
difference in imaging cycle Tcycle is 0 within a range over which the 
field angles or imaging cycle Tcycle is changed. 

20 [0174] 

Further, in the embodiment, as shown in FIG. 32, the cycle 
field angle adjusting unit A 204 is distributed at each camera 
terminal 101A to 101C. Needless to say, the same effect can be 
obtained where only one cycle field angle adjusting unit A 204 is 
25 present and the only one cycle field angle adjusting unit A 204 

controls the cycle Tcycle imaging zone field angles (and the panning 
and tilting speeds V P const and V t _const, imaging interval T s , and 
field angles of the time T imaging zone) of the camera 201 of the 
camera terminals 101A to 101C. 

30 

[0175] 

Further, in the embodiment, the network 103 is a network line 
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used for general communication. Needless to say, the same effect 
can be obtained regardless of that the network 103 is a wired or 
wireless network. 



5 [0176] 

In Embodiment 1, the imaging zone adjusting apparatus that 
self-adjusts the cycle Tcycle imaging zones of the cameras of the 
camera terminals so that a combined zone of the cycle T C ycle 
imaging zones of the cameras of the camera terminals completely 

10 covers a specific imaging target zone is described. In the 

embodiment, the operation of the imaging zone adjusting apparatus 
that further self-adjusts the imaging cycles T C ycle of the cameras of 
the camera terminals to be equal is described. When the 
adjustments cannot be performed independently, a function that 

is linearly adds the functions FA () and FB () for the terms that cannot 
be adjusted independently is defined and the steepest descendent 
method is applied. For example, as presented by the expression 61, 
a function FAB () that linearly adds the functions FA () and FB () is 
defined and the steepest descendent method is applied. 

20 

[0177] 
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[Math 61] 



Yam ^G AB {6b PA> 6b TA ,6b iiA ,6b VA ) 
FA A {X AL ,X AR ,Y AU , Y AB ) = , 0b rA , Ob HA ,6b yA ) = 

{XTL-GAL&PAJbr^Gb^db^-C) 2 + 

(G AR (eb PA ,eb TA ,m^,Gb yA )-x BL -cy + 

fr™ -G AU {Gb PA ,Bb TA ,eb HAi 6b VA )-C) 2 + 

(Gab(®> P a,®>ta>®>ha>®>va)-Ytb ~Cf 

FB A {8b HA ,eb VA ) = FB A{ , {6b ) + FB A v ( 6b VA ) 

^„ (»« , «fc . , ^ ) = (»« » »fc > »«| . ^ ) + ^ , ) 

»' = 6b PA _ a ^B A (6b PAi 6b TAS 6b HAi 6b VA ) 

30b PA 

6b' = 6b a dFAB * > 6h TA > 6h iu > ^va ) 
TA ™ 86b TA 

= . a dFAB Aeb PA ,9b TAi 6b HA ,6b VA ) 

ddb^ 

0h' -6b a dFAB * > 6b TA > eh n A . »n ) 

ya va " rrr 

d6b yA 



5 ...(Formula 61) 

(Embodiment 3) 

Embodiment 3 of the present invention is described hereafter. 
In the embodiment, an imaging zone adjusting apparatus in which 
the cycle Tcycle imaging zones of the cameras of the camera 
10 terminals are self-adjusted so that a combined zone of the cycle 
Tcycle imaging zones of the cameras of the camera terminals 
completely covers a specific imaging target zone and the imaging 
cycles Tcycle of the cameras of the camera terminals are 
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self-adjusted to be minimized is described with reference to FIGS. 
34 and 35. 

[0178] 

5 First, advantages of the imaging cycles T C ycle of the cameras 

of the camera terminals being minimized are described. The 
imaging zone adjusting apparatus described in Embodiment 1 allows 
the imaging zones of the cameras of the camera terminals to 
completely cover a specific imaging target zone. This does not 

10 mean that the imaging cycles T C ycle of the cameras of the camera 
terminals are minimized. When the imaging cycle Tcycle of the 
camera of a camera terminal is larger, the update of images of the 
cycle Tcycle imaging zone imaged by that camera terminal is delayed 
and it takes more time to find a detection target within that cycle 

15 Tcycle imaging zone. This is problematic when the imaging zone 
adjusting apparatus of the present invention is used for surveillance. 
Therefore, it is desired that the imaging cycles Tcycle of the cameras 
of the camera terminals are minimized. 

20 [0179] 

Components of the imaging zone adjusting apparatus of the 
embodiment are described hereafter. FIG. 34 is a block diagram 
showing the structure of the camera terminals 101A to 101C in FIG. 
26 (a). The camera terminals 101A to 101C each comprise at least 

25 a camera 201, an adjusting unit A 202, a communications unit 203, 
and a cycle field angle adjusting unit B 205. The camera 201 
comprises a lens 211, an image pickup surface 212, an image 
processor 213, an orientation controller 214, and a cycle imaging 
controller 215. The camera 201, adjusting unit A 202, 

30 communications unit 203, lens 211, image pickup surface 212, 

image processor 213, orientation controller 214, and cycle imaging 
controller 215 in FIG. 34 are the same as those in the block diagram 
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showing the structure of the camera terminals 101A to 101C of 
Embodiment 1 in FIG. 27. In the block diagram showing the 
structure of the camera terminals 101A to 101C of the embodiment 
in FIG. 34, the cycle Tcycle camera horizontal and vertical field 
5 angles 0b H and 0b v and the time T camera horizontal and vertical 
field angles 0a H and ©a v are not fixed values. The cycle field angle 
adjusting unit B 205 comprising a processor to adjust and output the 
field angles of the cycle Tcycle imaging zone and time T imaging zone 
of the camera 201 is added. 

10 

[0180] 

This is the only difference in components between 
Embodiment 1 and the embodiment. The imaging zone adjusting 
apparatus has the same structure as that in FIG. 26 (a), the imaging 
15 zone positions on the real space plane 113 of the imaging zone 
adjusting apparatus are the same as those in FIG. 26 (b), and the 
operation terminal 102 has the same structure as that in FIG. 28. 

[0181] 

20 With the addition of the cycle field angle adjusting unit B 205, 

in the embodiment, the adjusting unit A 202 and cycle field angle 
adjusting unit B 205 adjust the position and imaging cycle of the 
hypothetical imaging zone (the cycle Tcycle imaging zone in the 
embodiment) of one's own camera terminal so that the imaging 

25 cycle of the hypothetical imaging zone (the cycle Tcycle imaging zone 
in the embodiment) of one's own camera terminal is made smaller in 
addition to the adjustment of Embodiment 1. 

[0182] 

30 Operation of the imaging zone adjusting apparatus of the 

embodiment is described hereafter. The cycle field angle adjusting 
unit B 205 is the only additional unit in the embodiment compared to 
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Embodiment 1. The cycle field angle adjusting unit B 205 sends the 
cycle Tcycle camera horizontal and vertical field angles 0b H and 0b v 
and the time T camera horizontal and vertical field angles 0aH and 
©a v to the cycle imaging controller 215. Needless to say, the 
5 embodiment has all effects described for Embodiment 1. In other 
words, the imaging zones of the cameras of the camera terminals 
are self-adjusted so that a combined zone of the imaging zones of 
the cameras of the camera terminals completely covers a specific 
imaging target zone. 

10 

[0183] 

The cycle field angle adjusting unit B 205 performs the 
procedures of the steps below and shown in FIG. 35 based on field 
angel information of the cycle T C ycle imaging zone of one's own 
15 camera terminal. 



[0184] 

First, in Step 1001, updated values of the cycle T C ycle camera 
field angles of one's own camera terminal that lead the cycle Tcycle 

20 camera field angles to 0 are calculated. The calculation process is 
described hereafter. First, a function FC () presenting a quantity 
indicating the magnitude of the cycle T C ycle camera field angles is 
selected. In the embodiment, the function is presented by the 
expression 62. The expression 62 corresponds to the camera 

25 terminals 101A to 101C and yields the product of the cycle T C ycle 
camera horizontal and vertical field angles 0b H and 0b v as the 
quantity indicating their magnitude. Then, the generally known 
steepest descent method is used as presented by the expression 63 
to calculate the updated values of the cycle Tcycle camera field 

30 angles of one's own camera terminal. In the expression 63, 0b' H A, 
0b' VA , ©b' H B, Ob'vB, ©b' H c, and ©b'vc comprise the updated values of 
the cycle T C ycle camera field angles of the cycle TAcycle imaging zone 
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120A to cycle TCcycle imaging zone 120C, respectively, and a is a 
constant. 

[0185] 

5 In Step 1002, a determination is made as to whether the 

updated values of the cycle T C ycle camera field angles calculated In 
Step 1001 are equal to or less than the time T camera field angles, 
in other words, whether the updated value of the cycle Tcycle camera 
horizontal field angle 0b' H is equal to or less than the time T camera 
10 horizontal field angle 0a H (for the vertical field angle, whether the 
updated value of the cycle Tcycle camera vertical field angle 0b' v is 
equal to or less than the time T camera horizontal field angle Oav). 

[0186] 
15 [Math 62] 



FC A {9b m ,eb VA ) = Gb HA *6b VA 

FC b i eh HB > 6b m ) = 0h m X ®>VB 

FC C {Gb HC , 0b vc ) = 0b HC x 6b vc 



[0187] 



..(Formula 62) 



- 112- 



[Math 63] 
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10 



...(Formula 63) 
When the updated values of the cycle T C ycle camera field 
angles are greater than those of the time T camera field angles, the 
updated values of the cycle T C ycle camera field angles are adopted as 
the cycle T C ycle camera field angles and the cycle Tcycle camera field 
angles of the camera terminals 101A to 101C are adjusted for the 
cycle Tcycle camera field angles. 

[0188] 

When the updated values of the cycle Tcycle camera field 
angles are equal to or less than the time T camera field angles, 
updated values of the time T camera field angles of one's own 
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camera terminal that lead the time T camera field angles to 0 are 
calculated in Step 1004 because the cycle Tcycle camera field angles 
cannot be adjusted for values equal to or less than the time T 
camera field angles. The calculation process is described hereafter. 
5 First, a function FD () presenting a quantity indicating the 

magnitude of the time T camera field angles is selected. In this 
embodiment, the function is presented by the expression 64. The 
expression 64 corresponds to the camera terminals 101A to 101C 
and yields the product of the time T camera horizontal and vertical 

10 field angles 0a H and ©a v as the quantity indicating their magnitude. 
Then, the generally known steepest descent method is used as 
presented by the expression 65 to calculate the updated values of 
the time T camera field angles of one's own camera terminal. In the 
expression 65, ©b' H A, ©b' VA , ©b' H B, ©b' VB , ©b' H c, and ©b'vc comprise 

15 the updated values of the time T camera field angles of the cycle 
TAcycle imaging zone 120A to cycle TCcycle imaging zone 120C, 
respectively, and a is a constant. 

[0189] 
20 [Math 64] 



FD c (fa HC3 0a yc ) 




Oa m x 0a 
8a un *6a 



> 



...(Formula 64) 
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[Math 65] 
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.(Formula 65) 



10 



Then, in Step 1005, in Step 1004, the updated values of the time T 
camera field angles are adopted as the time T camera field angles 
and the time T camera field angles of the cycle Tcycle imaging zones 
of the camera terminals 101A to 101C are adjusted for the time T 
camera field angles. 



[0191] 



The cycle field angle adjusting unit B 205 performs the 
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procedures of Steps 1001 to 1005 in sequence and returns to the 
procedure of Step 1001 after completing the procedure of Step 1003 
or 1005. Constantly repeating the procedures of Steps 1001 to 
1005, the cycle field angle adjusting unit B 205 sends updated 
5 values of the cycle T C ycle camera horizontal and vertical field angles 
Ob' H and ©b' v or of the time T camera horizontal and vertical field 
angles ©a' H and ©a' v calculated by the expressions above to the 
cycle imaging controller 215 so that the field angles of the cycle 
Tcycle imaging zone of the camera 201 are adjusted. 

10 

[0192] 

The operation of the imaging zone adjusting apparatus of this 
embodiment is as described above. In Step 1001 or 1004, the field 
angles of the next cycle T C ycle imaging zone of one's own camera 

15 terminal is calculated using the steepest descent method in which 
the field angles converge of 0 and the field angles of the cycle Tcycle 
imaging zone of the camera 201 are adjusted for the field angles of 
the next the cycle Tcycle imaging zone. With the procedures of 
Steps 1001 to 1005 being repeated, the field angles of the cycle 

20 TAcycle imaging zone 120A, cycle TBcycle imaging zone 120B, and 
cycle TCcycle imaging zone 120C, or the cycle Tcycle imaging zones of 
the camera terminals 101A to 101C, are made smaller. If the field 
angles of the cycle Tcycle imaging zone of each camera terminal 
101A to 101C becomes smaller, the imaging zone cycles Tcycle of the 

25 camera terminals 101A to 101C become smaller according to the 
explanation of the imaging process of a cycle T C ycle imaging zone. 
In addition to the adjustment in Embodiment 1, the position and 
imaging cycle of the hypothetical imaging zone (the cycle Tcycle 
imaging zone in the embodiment) of one's own camera terminal is 

30 adjusted so that the imaging cycle of the hypothetical imaging zone 
(the cycle Tcycle imaging zone in the embodiment) of one's own 
camera terminal becomes smaller in the embodiment. 
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[0193] 

With the cycle field image adjusting unit B 205 repeating the 
procedures of Steps 1001 to 1005, the effect that the imaging cycle 
5 Tcycle is made smaller is obtained. No information on the cycle 
Tcycle imaging zones of the other cameras is necessary for the 
repeated procedures of Steps 1001 to 1005. Therefore, even if any 
change occurs in the cycle Tcycle imaging zones of the other cameras 
at each time point, the effect that the imaging cycle Tcycle is made 
10 smaller can be obtained regardless of that change. 

[0194] 

In this embodiment, the functions FC () and FD () yield the 
products of horizontal and vertical field angles, respectively, as 

15 presented by the expressions 62 and 57. Needless to say, the same 
effect can be obtained even if the functions FC () and FD () raise the 
products of horizontal and vertical field angles to a N-th power (N is 
a positive real number) because the functions FC () and FD () have 
the minimum values when the field angles are 0 and, therefore, the 

20 field angles converge of 0 as a result of the steepest descent method 
In Steps 1001 and 1004. 

[0195] 

Needless to say, similar to Embodiment 1, the same effect can 
25 be obtained even if the functions FC () and FD () presenting the 
magnitudes of the field angles have minimal values, not the 
minimum values, when the field angles are 0 as long as the functions 
FC () and FD () have the minimum values when the field angles are 
0 within ranges over which the field angles are changed. 
30 Further, in this embodiment, as shown in FIG. 34, the cycle field 
angle adjusting unit B 205 is distributed at each camera terminal 
101A to 101C. Needless to say, the same effect can be obtained 
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where only one cycle field angle adjusting unit B 205 is present and 
the only one cycle field angle adjusting unit B 205 controls the field 
angles of the cycle Tcycle imaging zones of the cameras 201 of the 
camera terminals 101A to 101C. 

5 

[0196] 

Further, in this embodiment, the network 103 is a network 
line used for general communications. Needless to say, the same 
effect can be obtained regardless of whether the network 103 is a 
10 wired or wireless network. 

[0197] 

In Embodiment 1, the imaging zone adjusting apparatus that 
self-adjusts the cycle Tcycle imaging zones of the cameras of the 

15 camera terminals so that a combined zone of the cycle Tcycle 

imaging zones of the cameras of the camera terminals completely 
covers a specific imaging target zone is described. In the 
embodiment, the operation of the imaging zone adjusting apparatus 
that further self-adjusts the imaging cycles Tcycle of the cameras of 

20 the camera terminals to be smaller is described. When the 

self-adjustment cannot be performed independently, a function that 
linearly adds the functions FA () and FC () for the terms that cannot 
be adjusted independently is defined and the steepest descendent 
method is applied. For example, as present by the expression 66, a 

25 function FAC () that linearly adds the functions FA () and FC () is 
defined and the steepest descendent method is applied. 

[0198] 
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[Math 66] 



*al - &ai {Ob PA , Ob TA , Ob HA ,0b M ) 

X AR = G AP ( 6b PA > 6h TA > Gb HA > G Ka ) 
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y M = Gab (« 'pa . - 3 <&r« ) 

) = FA A (eb, A ,6b TA ,eb HA ,eb yA ) = 
~G AL {eb PAS eb TA ,eb llAi eb VA )-c) 2 + 
{G AR {eb PA ,eb TAi eb HAi % VA )-x BL -cf + 
&v -G AI A0b PA ,eb rA ,eb HA ,eb M )-cy + 

FC A ieb HAt Gb VA } = Gb m *6b VA 
FA C A (Ob PA , fl^ s 6b M , Ob VA ) = FA A {Ob F , Ob TA , , «^ ) + FC A {6b HA , 6b VA ) 
eb ), A = 9b PA _ a ^AC A (% PAi % TAi Ob HA ^ A ) 

& = £ fc a ^G A {Ob PAS Ob TAt Ob tiA ,0b M ) 
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* m = _ a ^cAeb PA ,ob TA ,eb HAi ob VA ) 
ob' =ob a dFAC Aoh PA ^ TA ,eb HAl eb VA ) 
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...(Formula 66) 

5 Further, in this embodiment, the procedure of the flowchart 

shown in FIG. 35 realizes a process to make the field angles of the 
cycle Tcycle imaging equal to or less than the field angles of the time 
T imaging zone. In Embodiments 1, 2, and 4, when the field angles 
of the cycle Tcycle imaging zone need to be made equal to or less 
10 than the field angles of the time T imaging zone, the procedure of 
the flowchart shown in FIG. 35 can be incorporated to realize this 
process. 
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[0199] 

(Embodiment 4) 

Embodiment 4 of the present invention is described hereafter. 
In this embodiment, an imaging zone adjusting apparatus in which 
5 the positions of the cycle T C ycle imaging zones of the cameras of the 
camera terminals are self-adjusted so that a combined zone of the 
cycle Tcycle imaging zones of the cameras of the camera terminals 
completely covers a specific imaging target zone and, further, the 
aspect ratios of the cycle T C ycle imaging zones of the cameras of the 
10 camera terminals are self-adjusted for specific aspect ratios, 

whereby the specific imaging target zone is efficiently imaged is 
described with reference to FIGS. 29 to 32. In this embodiment, the 
specific aspect ratios comprise the aspect ratios of the time T 
imaging zones. 

15 

[0200] 

First, the aspect ratio is described. The aspect ratio of an 
imaging zone in this embodiment is the ratio of length to width of a 
time T imaging zone or a cycle Tcycle imaging zone, which is a 

20 so-called aspect ratio. With reference to FIG. 12 (a) and (b), the 
aspect ratio can be expressed as the ratio of the horizontal field 
angle to the vertical field angle of a camera. Then, in Embodiment 
4, the aspect ratio of a cycle Tcycle imaging zone is expressed by a 
cycle Tcycle camera horizontal field angle 0b H / a cycle Tcycle camera 

25 vertical field angle 0b v and the aspect ratio of a time T imaging zone 
is expressed by a time T camera horizontal field angle ©a H / a time 
T camera vertical field angle ©a v . 

[0201] 

30 The fact that a specific imaging target zone is efficiently 

imaged by self-adjusting the aspect ratio of the cycle Tcycle imaging 
zone of the camera terminals for the aspect ratio of the time T 
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imaging zone is described with reference to FIGS. 36 and 37 and 
using examples. Here, the above "efficiently imaged" means that 
cameras are required less motion to image one and the same 
hypothetical imaging zone (the cycle Tcycle imaging zone in this 
5 embodiment) or overlapping zone with adjacent hypothetical 

imaging zones (the cycle Tcycle imaging zone in this embodiment) 
are smaller. 

[0202] 

10 FIGS. 36 (a), 36 (b), 37 (a), and 37 (b) illustrate the positions 

of the cycle Tcycle imaging zones of the cameras of the camera 
terminals being self-adjusted so that a combined zone of the cycle 
Tcycle imaging zones of the cameras of the camera terminals 
completely covers a specific imaging target zone according to the 

15 operation described in Embodiment 1. The camera terminal 101B, 
cycle TAcycle imaging zone 120A, cycle TB C ycle imaging zone 120B, 
cycle TCcycle imaging zone 120C, and imaging target zone 121 in the 
figures are the same as those of Embodiment 1 in FIG. 26 (a). A 
time T imaging zone 2701, a time T camera horizontal field angle 

20 0a H 2702, a time T camera vertical field angle 0a v 2703, a cycle 
Tcycle camera horizontal field angle 0b H 2704, and a cycle Tcycle 
camera vertical field angle0b v 2705 comprise the same as the time 
T imaging zone 5202, time T camera horizontal field angle 0a H 5204, 
time T camera vertical field angle ©a v 5205, cycle Tcycle camera 

25 horizontal field angle 0b H 5212, and cycle Tcycle camera vertical field 
angle0b v 5213 in FIG. 12 (a) and (b). These elements are all for 
the camera terminal 101B. 

[0203] 

30 A first embodiment is described hereafter with reference to 

FIG. 36. FIG. 36 (a) illustrates an embodiment in which the time T 
camera horizontal field angle 0a H > the cycle T C ycle camera 
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horizontal field angle 0b H and the time T camera vertical field angle 
©a v > the cycle T C ycle camera vertical field angle 0b v , in other words, 
both the horizontal field angle and the vertical field angle of the 
cycle TBcycle imaging zone 120B are equal to or less than those of 
5 the time T imaging zone of the camera terminal 101B. FIG. 36 (b) 
illustrates an embodiment in which the time T camera horizontal 
field angle 0a H < the cycle T C ycle camera horizontal field angle 0b H 
and the time T camera vertical field angle 0a v > the cycle T C ycle 
camera vertical field angle 0b V/ in other words, the horizontal field 

10 angle of the cycle TBcycle imaging zone 120B is greater than that of 
the time T imaging zone of the camera terminal 101 B. According to 
the imaging process of a cycle T C ycle imaging zone described above, 
the time T imaging zone of the camera terminal 101B allows the 
entire cycle TBcycle imaging zone 120B to be imaged at a time (the 

15 cycle Tcycle = 0); consequently, the entire cycle TB imaging zone 
120 is constantly imaged in the embodiment shown in FIG. 36 (a). 
However, the time T imaging zone of the camera terminal 10 IB does 
not allow the entire cycle TBcycle imaging zone 120B to be imaged at 
a time; consequently, the entire cycle TBcycle imaging zone 120B is 

20 not constantly imaged in the embodiment shown in FIG. 36 (a). If 
possible, it is ideal for surveillance apparatus and efficient in 
imaging that the cycle Tcycle imaging zones of the cameras of the 
camera terminals are self-adjusted so that a combined zone of the 
cycle Tcycle imaging zones of the cameras of the camera terminals 

25 completely covers a specific imaging target zone in the manner of 
the embodiment shown in FIG. 36 (a) where constant imaging is 
available rather than in the manner of the embodiment shown in FIG. 
36 (b). In the embodiment shown in FIG. 36 (a), compared to the 
embodiment shown in FIG. 36 (b), the time T camera horizontal field 

30 angle 0a H / the time T camera vertical field angle ©a v ~ the cycle 
Tcycle camera horizontal field angle 0b H / the cycle Tcycle camera 
vertical field 0b v , in other words, the aspect ratio of the time T 
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imaging zone = the aspect ratio of the cycle T C ycle imaging zone. In 
the embodiment shown in FIG. 36 (b), compared to the embodiment 
shown in FIG. 36 (a), the time T camera horizontal field angle @a H / 
the time T camera vertical field angle ©av * the cycle Tcycle camera 
5 horizontal field angle 0b H / the cycle Tcycle camera vertical field ©bv, 
in other words, the aspect ratio of the time T imaging zone * the 
aspect ratio of the cycle Tcycle imaging zone. Therefore, higher 
imaging efficiency is obtained when the aspect ratio of the cycle 
Tcycle imaging zone is nearly equal to the aspect ratio of the time T 
10 imaging zone. 

[0204] 

A second embodiment is described hereafter with reference to 
FIG. 37. The time T camera horizontal field angle ©a H > the cycle 
15 Tcycle camera horizontal field angle @b H and the time T camera 

vertical field angle ©a v > the cycle Tcycle camera vertical field angle 
©b v in FIG. 37 (a) and the time T camera horizontal field angle ©a H 

> the cycle Tcycle camera horizontal field angle ©bH and the time T 
camera vertical field angle ©a v > the cycle Tcycle camera vertical 

20 field angle ©bv in FIG. 37 (b), in other words, both the horizontal 
field angle and the vertical field angle of the cycle TB C ycle imaging 
zone 120B are equal to or less than those of the time T imaging zone 
of the camera terminal 101B. Therefore, in both embodiments, the 
entire cycle TBcycle imaging zone 120B is constantly imaged. In 

25 this point, higher imaging efficiency is obtained. However, FIG. 37 
(a) further illustrates an embodiment in which the time T camera 
horizontal field angle ©a H / the time T camera vertical field angle ©a v 

> the cycle Tcycle camera horizontal field ©b H angle / the cycle Tcycle 
camera vertical field angle©b v , in other words, the aspect ratio of 

30 the time T imaging zone > the aspect ratio of the cycle Tcycle 

imaging zone. On the other hand, FIG. 37 (b) further illustrates an 
embodiment in which the time T camera horizontal field angle @a H / 
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the time T camera vertical field angle 0av < the cycle Tcycle camera 
horizontal field 0b H angle / the cycle Tcycle camera vertical field 
angle 0b V/ in other words, the aspect ratio of the time T imaging 
zone < the aspect ratio of the cycle Tcycle imaging zone. Therefore, 
5 according to the imaging process of a cycle Tcycle imaging zone 
described above, the time T C ycle imaging zone of the camera 
terminal 101B allows for the imaging of the cycle TAcycle imaging 
zone 120A and cycle TCcycle imaging zone 120C that comprise to be 
imaged by the camera terminals 101A and 101C in the horizontal 

10 and vertical directions while the cycle TBcycle imaging zone 120B is 
imaged in both embodiments shown in FIG. 37 (a) and (b). The 
cycle TAcycle imaging zone 120A and cycle TCcycle imaging zone 
120C are supposed to be imaged by the camera terminals 101A and 
101C, respectively. Therefore, the camera terminal 101B conducts 

15 redundant imaging of these zones. When the camera terminal 

101B images only the TBcycle imaging zone 120B, which is smaller 
than the zone above, as in the embodiment shown in FIG. 36 (a) 
where possible, detailed images of higher resolutions of the zone 
can be obtained and, consequently, higher imaging efficiency is 

20 obtained. In the embodiments shown in FIG. 37 (a) and (b), 
compared to the embodiment shown in FIG. 36 (a), the time T 
camera horizontal field angle 0a H / the time T camera vertical field 
angle 0a v * the cycle Tcycle camera horizontal field angle 0b H / the 
cycle Tcycle camera vertical field angle 0b V/ in other words, the 

25 aspect ratio of the time T imaging zone * the aspect ratio of the cycle 
Tcycle imaging zone. In the embodiment shown in FIG. 36 (a), 
compared to the embodiments shown in FIG. 37 (a) and (b), the 
time T camera horizontal field angle 0a H / the time T camera vertical 
field angle 0a v = the cycle Tcycle camera horizontal field angle 0b H / 

30 the cycle Tcycle camera vertical field angle 0b v , in other words, the 
aspect ratio of the time T imaging zone = the aspect ratio of the cycle 
Tcycle imaging zone. Therefore, higher imaging efficiency is 
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obtained when the aspect ratio of the cycle T C ycle imaging zone is 
nearly equal to the aspect ratio of the time T imaging zone. 
[0205] 

Components of the imaging zone adjusting apparatus of the 
5 embodiment are described hereafter. FIG. 38 is a block diagram 
showing the structure of a camera 201 in the embodiment, which 
corresponds to the camera terminals 101A to 101C in FIG. 26 (a). 
The camera terminals 101A to 101C each comprise at least a camera 
201, an adjusting unit C 208, and a communications unit 203. The 

10 camera 201 comprises a lens 211, an image pickup surface 212, an 
image processor 213, an orientation controller 214, and a cycle 
imaging controller 215. The camera 201, communications unit 203, 
lens 211, image pickup surface 212, image processor 213, 
orientation controller 214, and cycle imaging controller 215 in FIG. 

15 38 are the same as those in the block diagram showing the structure 
of the camera terminals 101A to 101C of Embodiment 1 shown in FIG. 
27. The adjusting unit A 202 of Embodiment 1 is replaced by the 
adjusting unit C 208 in the block diagram showing the structure of 
the camera terminals 101A to 101C of the embodiment shown in FIG. 

20 38. 



[0206] 

The adjusting unit C 208 is a processor to adjust the position 
and aspect ratio of the hypothetical imaging zone (the cycle Tcycle 
25 imaging zone in the embodiment) of one's own camera terminal so 
that the aspect ratio of the hypothetical imaging zone (the cycle 
Tcycle imaging zone in the embodiment) of one's own camera 
terminal has a specific target quantity in addition to the adjustment 
of Embodiment 1. 

30 

[0207] 

This is the only difference in components between 
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a 



Embodiment 1 and the embodiment. The imaging zone adjusting 
apparatus has the same structure as that in FIG. 26 (a), the imaging 
zone positions on the real space plane 113 of the imaging zone 
adjusting apparatus are the same as those in FIG. 26 (b), and the 
5 operation terminal 102 has the same structure as that in FIG. 28. 
In FIG. 26 (b), the cycle TAcycle imaging zone 120A has a measure of 
X A r - X A l in the horizontal (X w -axis 110) direction and a measure of 
Yab - Y A u in the vertical (Y w -axis 111) direction and an aspect ratio 
of (X AR - X AL ) / ( Y AB - Y AU ). The cycle TB C ycle imaging zone 120B 

io has a measure of X B r - X B l in the horizontal direction and a measure 
of Y B b - Y B u in the vertical direction and an aspect ratio of (X B r - X B l) 
/ ( Y BB - Y BU ). The cycle TCcycle imaging zone 120C has a measure 
of X C r - X C l in the horizontal direction and a measure of Y CB - Y C u in 
the vertical direction and an aspect ratio of (X C r - X C l) / ( Y CB - Y C u). 

15 The aspect ratio of the cycle TAcycle imaging zone 120A is also ©b H A 
/ 0b V A; the aspect ratio of the cycle TBcycle imaging zone 120B is 
also 0b HB / 0b VB ; and the aspect ratio of the cycle TCcycle imaging 
zone 120C is also 0b H c / 0b V c- 

20 [0208] 

Operation of the imaging zone adjusting apparatus of the 
embodiment is described hereafter. The only change in the 
embodiment in comparison with Embodiment 1 is the replacement of 
the adjusting unit A 202 by the adjusting unit C 208. Therefore, 
25 operation of only the adjusting unit C 208 is described. 

[0209] 

Similar to the adjusting unit A 202, the adjusting unit C 208 
periodically sends the positional information of the cycle T C ycle 
30 imaging zone of the camera 201 sent from the cycle imaging 
controller 215 to the adjusting unit C 208 of the other camera 
terminals via the communications unit 203 and network 103. The 
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adjusting unit C 208 further, also similar to the adjusting unit A 202, 
receives the positional information of the cycle T C ycle imaging zones 
of the cameras 201 of the other camera terminals periodically sent 
from the adjusting unit C 208 of the other camera terminals. 
5 Therefore, similar to Embodiment 1, the adjusting unit C 208 of the 
camera terminals 101A to 101C periodically obtains the positional 
information of the cycle T C ycle imaging zones of one's own camera 
terminal and other camera terminals and the positional information 
of the imaging target zone 121. 

10 

[0200] 

The adjusting unit C 208 further performs the procedures of 
the steps shown in FIG. 39 similar to Embodiment 1 based on the 
obtained positional information of the cycle Tcycle imaging zones and 
15 imaging target zone 121 (which is also the positional information of 
the non-imaging zone 122). 

[0211] 

First, in Step 3001, a cycle Tcycle imaging zone of another 
20 camera terminal adjacent to the cycle Tcycle imaging zone of one's 
own camera terminal or the non-imaging zone 122 is selected based 
on the information indicating the cycle Tcycle imaging zone positions 
of the cameras 201 of one's own camera terminal and other camera 
terminals. The procedure of the step is the same as in Embodiment 
25 1 (Step 401 in FIG. 29). 

[0212] 

Then, in Step 3002, a quantity indicating the magnitude of 
the overlapping zone where the imaging zone selected In Step 3001 
30 and the imaging zone of one's own camera terminal overlap is 
calculated. The procedure of the step is also the same as in 
Embodiment 1 (Step 402 in FIG. 29). 
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[0213] 

Then, in Step 3003, the position of the imaging zone of one's 
own camera terminal is adjusted so that the quantity indicating the 
5 magnitude of the overlapping zone calculated In Step 3002 

converges on a fixed quantity Coverlap and the aspect ratio of the 
imaging zone of one's own camera terminal is adjusted so that the 
aspect ratio of the imaging zone converges on a fixed quantity 
Caspect- The adjustment process is described hereafter. A function 

10 FA () presented by the expressions 67 to 69 as is in Embodiment 1 
is selected to yield a quantity indicating the difference between the 
quantity indicating the magnitudes of the overlapping zone and a 
fixed quantity Coverlap equal to or greater than 0. Further, a 
function FE () is selected to yield a quantity indicating the difference 

15 between the aspect ratio of the imaging zone and a fixed quantity 
Caspect- This function is presented by the expression 70 in the 
embodiment. Then, a function FX () presented by the expression 
71 is selected to yield the linear addition of the functions FA () and 
FE (). In the expression 71, p A and p B are constants. 

20 

[0214] 
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[Math 67] 



FA A (X^X ) = FA A (X AL )+ ™ ah {X M )+ FA AU {Y M )+ FA M (Y AB )} 

X al'^ G al farA ' Gb rA > & ha » 6b VA ) 

X AR — g ar (&bpA • Gbj-A > 0btfA , 6b VA ) 

r /ju = [ eb PA j s ^/n > ^ ) 
= G AB (Ob PA , 6& r>< , 6& H/) , ) 

( X tl ~G AL (6bp A ,6b TAi 6b HA ,6b VA )-C oyER1AP ) 7 + 

{GAeb PA M T A>®> m M V AY Xbl ~ Gqverup y + 
i Y ru " G AU (6b FA , 6b TA , 6b HA , 6b VA ) - C ovmM> f + 
(G A 3 (Gb PA , 6b TA , 6b HA , 6b YA )- Y m - C 0VER1AP ) 2 

...(Formula 67) 

5 [0215] 
[Math 68] 



FA B (X BL ,X m ,Y BU ,Y BB ) = FA BL (X B J+FA BR (X BR hFA BU (Y BU )+ 

X D l = G BL [6b PB 5 6b TSS , 6b HB , 6b m ) 

X B r ~ G s „[6b j:gt eb TB ,6b HB ,eby B ) j 

Yeu = G BU (6b FB . 6b TB . 6b H3 . Bbyg ) 

y bb = G B3 (&b PB , 6& ra , Ob HB , Obyp ) 
FA B (X^ , X Bn , Y BU ,Y eB ) = FA B (6b ps , 6b m , 6b m , 6b y3 ) = 

(X A!i - <3 BL {dbj, B , Objjj , 6b HB , Gbyz ) - C OVEmAP ) J 4 

{G BR (6b fB , 6b TB , 6b HB , 6b m )~~X CL — C oyERLAP ) ? + [ 

On/ ~ G BU [9b PB , 6b n , 6b HB , <9b ra ) - C oyERLAP f -f 

(G bb ( 0 b PB . 6b m , 6b HB 1 6b f/g )- Y TB - C OVERLAJ> ) £ 



io ...(Formula 68) 

[0216] 
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[Math 69] 



FA C (X CL ,X ( 



'cnJcuJc*) = FAatea)* ™ca(*cJ+ ^4cuC»ai)+ ^4cafc«)" 
, (0b or , 6br^,6bur , Gb^ ) 



x ci rzG c^ 

x cr = G cn (®>pc » 0b Te> 0b Hc > %c ) 
= G cu fare ' » ^wc * ^Vc ) 

FA C (Xcl , . Y cu , Y CB ) = FA C {6b ^ , 0d rc , 6b HC , Ob^ ) = 
(X m - G a (6b PC , Ob^ , Qb HQ ,Gb vc )- C ox/mAP f + 

X TR ^OVERLAP ) + 

(Yjh —G c ^ h nh ah ah \—r" \ 2 ^ 



[0217] 
[Math 70] 



~ OVERLAP ) + 

V Til ^ CM V^ft ' G^TC ' ffifiC J ^Vc ) ' ^OVERLAP Y 4 

{G CB (6b , db^ , 0b HC , 6b n: ) - Y TB - C owr/Uj4/ , J 2 



...(Formula 69) 



FE A (0b HA ,0b VA ) = 



FE B (0b HB ,0b lm ) = 



FE c (6b HC ,eb vc ) = 



6b 



HA 



-C 



f 



6b 



HE 



r 



6b 



nc 



V 6b vc 



V 



ASPECT 



J 

V 



c 



ASPECT 



J 
\2 



-c 



ASPECT 



J 



10 [0218] 



...(Formula 70) 
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[Math 71] 



FX A {Ob PA ,0b T j,8b HA ,0b M ) = 

J3 A xFA A {0b FA: Ob TA! 0b HA ,0b, /A ) + 
FX a {6b ps , 6b T3 , 6b m , 6b VB ) = 

fi A *FA B {eb n9 eb n ,eb ma eb m )+p B *FE B {eb mt eb w ') 

FX C {Ob PC , Ob^. , 6b HC , Ob.^ ) = 



...(Formula 71) 

5 Then, the generally known steepest descent method is used 

as presented by the expressions 72 and 74 to calculate the position 
of the next imaging zone of one's own camera terminal. 

[0219] 
10 [Math 72] 



0b PA = 6b DA - a 



dFX A {eb PA ,eb TA ,eb HA ,eb VA ) 



PA 



36b 



6b TA — OK* - a 



TA 



dFX A [ob PA , 0b TA , eb m , Bb VA ) 



d6b 



eb m = 0b 



HA 



a 



TA 

dFX A {0b PA ,6b TAs 6b m ,eb VA ) 



36b 



HA 



6b VA = 6b VA - a 



VA 



3FX A {6b PA ,6b TA ,6b HA M VA ) 
36b„ A 



[0220] 



...(Formula 72) 
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[Math 73] 



Ob' =0b a dFX B {d b PB » & b m » Sbjg ; ^ra ) 

^' = ^ a dfi3f j (66^ , , Ob HB , Qb ]n} ) 
™ TB d6b TB 

Ob' =&b a 3FXb ^° bpB 9 0b ™ ' Qhm ' 6h]/B I 

GId =6b a 9FXb ^ bpB 9 TB 9 ® bnB 3 ^ byB ^ 

dOb VB 

...(Formula 73) 

5 [0221] [Math 74] 



Ob =0b a dFX ° ^ ebpc 9 6h]x: 3 6b}iC 9 6hvc i 
PC PC d6b PC 

0b > =0b a dFX c (6b PC ,eb TC3 6b HC ,Gb vc ) 

d6b TC 

HC HC d8b HC 

Ah' -Ah rv dFX C \® b PC > ® b TC I Gb HC > 0b VC J 

Vb vc - Ub vc - a — 

oUb vc 

...(Formula 74) 
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The adjusting unit C 208 performs the procedures of Steps 
3001, 3002, and 3003 in sequence and returns to the procedure of 
Step 3001 after completing the procedure of Step 3003. 

Constantly repeating the procedures of Steps 3001 to 3003, 
5 the adjusting unit C 208 sends undated values of the cycle Tcycle 
camera panning angle 0b' P A (or 0b' PB or 0b' P c), cycle T C ycle camera 
tilting angle ©b ' T a (or 0b ' TB or 0b ' T c), cycle T C ycle camera horizontal 
field angle 0b' HA (or ©b' H B or 0b' HC ), and cycle Tcycle camera vertical 
field angle 0b' VA (or 0b' VB or ©b ' vc ) calculated using the expressions 
10 above to the cycle imaging controller 215 so that the position of the 
cycle Tcycle imaging zone of the camera 201 is adjusted. 

[0222] 

The operation of the imaging zone adjusting apparatus of the 

15 embodiment is as described above. In Step 3003, the position of 
the next cycle Tcycle imaging zone of one's own camera terminal is 
calculated by the steepest descent method in which the quantity 
indicating the magnitude of the overlapping zone converges on a 
fixed quantity Coverlap equal to or greater than 0 and the position of 

20 the cycle Tcycle imaging zone of the camera 201 is adjusted for the 
next cycle Tcycle imaging zone position. Therefore, with the 
procedures of Steps 3001 to 3003 being repeated, the cycle TA C ycle 
imaging zone 120A, cycle TBcycle imaging zone 120BA, and cycle 
TCcycle imaging zone 120C, or the cycle T C ycle imaging zones of the 

25 camera terminals 101A to 101C, and the non-imaging zone 122 
overlap with each other by a fixed quantity Coverlap equal to or 
greater than 0. As shown in FIG. 26, when the cycle Tcycle imaging 
zones of the camera terminals and the non-imaging zone 122 
overlap with each other by a fixed quantity Coverlap equal to or 

30 greater than 0, the imaging target zone 121 is covered by a 
combined zone of the cycle Tcycle imaging zones of the camera 
terminals. Therefore, the imaging zone adjusting apparatus of the 
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present invention allows the camera terminals 101A to 101C to 
image the imaging target zone 121 with no blind spots. 

[0223] 

5 In Step 3003, the aspect ratio of the next cycle T C ycle imaging 

zone of one's own camera terminal is calculated by the steepest 
descent method in which the aspect ratio of the imaging zone 
converges on a fixed quantity Caspect and the aspect ratio of the 
cycle Tcycle imaging zone of the camera 201 is adjusted for the next 

10 cycle Tcycle imaging zone position. Therefore, the aspect ratios of 
the cycle TAcycle imaging zone 120A, cycle TB C ycle imaging zone 
120B, and cycle TCcycle imaging zone 120C, or the cycle Tcycle 
imaging zones of the camera terminals 101A to 101C, are adjusted 
for a fixed quantity Caspect- Assuming that the fixed quantity 

is Caspect is the aspect ratio of the time T imaging zone of the camera 
terminals 120A to 120C, the aspect ratio of the cycle T C ycle imaging 
zone of the camera of the camera terminals is adjusted for the 
aspect ratio of the time T imaging zone. Then, as described above, 
the imaging zone adjusting apparatus of the present invention 

20 allows the imaging target zone 121, or a specific imaging target 
zone, to be efficiently imaged. 

[0224] 

With the adjusting unit C 208 repeating the procedures of 
25 Steps 3001 to 3003, the effect is obtained that the imaging target 
zone 121 is efficiently imaged with no blind spots. The procedures 
of Steps 3002 and 3003 are repeated for the cycle Tcycle imaging 
zone of another camera terminal adjacent to the cycle Tcycle imaging 
zone of one's own camera terminal and the non-imaging zone 122, 
30 which is selected In Step 3001. 

[0225] 
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Therefore, similar to Embodiment 1, even if any change 
occurs in the position of the cycle Tcycle imaging zone of another 
camera adjacent to the cycle T C ycle imaging zone of one's own 
camera terminal or the position of the non-imaging zone 122 (which 
5 is also the position of the imaging target zone 121), the effect that 
the imaging target zone 121 is imaged with no blind spots can be 
obtained in accordance with the change. The position of the cycle 
Tcycle imaging zone or imaging target zone 121 can be changed 
when : 

10 (1) the cycle Tcycle imaging zone of a camera terminal is 
intentionally changed; 

(2) an additional camera terminal is installed; 

(3) some of the camera terminals are removed or unserviceable; or 

(4) the imaging target zone position sent from the operation 

15 terminal is changed. The operation of the present invention in 

response to the situational changes is described in Embodiments 6 
and 7, described later. Even if the cycle Tcycle imaging zone 
position sent from the camera terminals or the imaging target zone 
position sent from the operation terminal is changed or not sent, or 

20 a new cycle Tcycle imaging zone position is sent according to these 
changes, the imaging zone adjusting apparatus of the present 
invention allows the camera terminals to image the imaging target 
zone with no blind spots in accordance with changes in the cycle 
Tcycle imaging zone position or imaging target zone position. 

25 

[0226] 

In the embodiment, the function FE () presenting the 
difference between the aspect ratio of the imaging zone and a fixed 
quantity Caspect is, as presented by the expression 70, a function 
30 which raises the difference between the aspect ratio of the imaging 
zone and a fixed quantity Caspect to the second power. However, 
similar to the function FA () in Embodiment 1, the function FE () can 
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1 



be a function raising the difference between the aspect ratio of the 
imaging zone and a fixed quantity Caspect to an even-numbered 
power such as the fourth, sixth, and tenth power or a function 
yielding the absolute value of the difference between the aspect 
5 ratio of the imaging zone and a fixed quantity Caspect- The 

functions FE () have the minimum values when the aspect ratio of 
the imaging zone is Caspect and the aspect ratio of the imaging zone 
converges on a fixed quantity Caspect in the steepest descent method 
In Step 3004. Needless to say, the same effect can be obtained. 

10 

[0227] 

Needless to say, similar to the function FA () in Embodiment 1, 
the same effect can be obtained even if the function FE () presenting 
the difference between the aspect ratio of the imaging zone and a 
15 fixed quantity Caspect has a minimal value, not the maximum value, 
when the aspect ratio of the imaging zone is Caspect as long as the 
function FE () has the minimum value when the aspect ratio of the 
imaging zone is Caspect within a range over which the aspect ratio of 
the imaging zone is changed. 

20 

[0228] 

In the embodiment, as shown in FIG. 38, the adjusting unit C 
208 is distributed at each camera terminal 101A to 101C. Needless 
to say, the same effect can be obtained where only one adjusting 
25 unit C 208 is present and the only one adjusting unit C 208 controls 
the position and aspect ratio of the camera 201 of the camera 
terminals 101A to 101C. 

[0229] 

30 In the embodiment, the network 103 is a network line used 

for general communication. Needless to say, the same effect can 
be obtained regardless of that the network 103 is a wired or wireless 
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[0230] 

In the embodiment, the function FA () presenting the 
5 difference between a quantity indicating the magnitude of the 
overlapping zone and a fixed quantity Coverlap/ which is used to 
adjust the position of the cycle T C ycle imaging zones of the camera 
terminals 120A to 120C so that a combined zone of the cycle Tcycle 
imaging zones of the cameras of the camera terminals 120A to 120C 

10 completely covers the imaging target zone 121, and the function FE 
() presenting the difference between the aspect ratio of the imaging 
zone and a fixed quantity Caspect/ which is used to adjust the aspect 
ratio of the cycle Tcycle imaging zone of the camera of the terminals 
120A to 120C so that the imaging target zone 121 is efficiently 

15 imaged, are linearly added. Then, the position of the next imaging 
zone of one's own camera terminal is calculated and adjusted by the 
steepest descent method as presented by the expressions 72 to 74. 
The function FX () resulting from the linear addition of the functions 
FA () and FE () may have a minimal value, not the minimum value, 

20 when the quantity indicating the magnitude of the overlapping zone 
is Coverlap and the aspect ratio of the imaging zone is Caspect. In 
such a case, the following process can be used to self-adjust the 
position of the cycle Tcycle imaging zone of the camera of the camera 
terminals 120A to 120C so that a combined zone of the cycle Tcycle 

25 imaging zones of the cameras of the camera terminals 120A to 120C 
completely covers the imaging target zone 121 and to self-adjust 
the aspect ratio of the cycle Tcycle imaging zone of the camera of the 
camera terminals 120A to 120C for a specific aspect ratio as much as 
possible, thereby efficiently imaging the imaging target zone 121. 

30 

[0231] 

With the camera terminals 120A to 120C, when there is no 
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overlapping zone where the cycle T C ycle imaging zone of one's own 
camera terminal and an adjacent cycle T C ycle imaging zone or the 
non-imaging target zone 122 overlap or when the magnitude of the 
overlapping zone is equal to or less than Caspect (which can be 
5 determined by the adjusting unit C 208 based on the positional 
information of the cycle T C ycle imaging zones of the camera 
terminals and non-imaging zone 121 sent to and from the adjusting 
unit C 208), for example, p A and p B in the expression 71 are assumed 
to be 1 and 0, respectively. Then, the function FX () is a function 

10 consisting of only the function FA (). Consequently, the positions of 
the cycle T C ycle imaging zones of the cameras of the camera 
terminals 120A to 120C are self-adjusted so that a combined zone of 
the cycle T C ycle imaging zones of the cameras of the camera 
terminals 120A to 120C completely covers the imaging target zone 

15 121. On the other hand, with the camera terminals 120A to 120C, 
when there is an overlapping zone where the cycle T C ycle imaging 
zone of one's own camera terminal and an adjacent cycle T C ycle 
imaging zone or the non-imaging target zone 122 overlap or when 
the magnitude of the overlapping zone is equal to or greater than 

20 Caspect, this is the result of the positions of the cycle T C ycle imaging 
zones of the cameras of the camera terminals being self-adjusted so 
that a combined zone of the cycle T C ycle imaging zones of the 
cameras of the camera terminals 120A to 120C completely covers 
the imaging target zone 121. Therefore, both p A and p B in the 

25 expression 71 are assumed to be 1. Then, the function FX () is a 
function resulting from the linear addition of the functions FA () and 
FE (). Further, the aspect ratio of the cycle Tcycle imaging zone of 
the camera of the camera terminals 120A to 120C is self-adjusted, 
whereby the imaging target zone 121 is efficiently imaged. 

30 

[0232] 

The fact that a specific imaging target zone is efficiently 
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imaged when the aspect ratio of the cycle Tcycle imaging zone of the 
camera of the camera terminals 120A to 120C is self-adjusted for 
the aspect ratio of the time T imaging zone is described above with 
reference to FIGS. 36 and 37. According to the embodiments 
5 shown in FIGS 36 and 37, the requirements for the imaging target 
zone 121 to be efficiently imaged include the time T camera 
horizontal field angle 0a H > the cycle Tcycle camera horizontal field 
angle 0b H and the time T camera vertical field angle 0a v > the cycle 
Tcycle camera vertical field angle 0b v . Then, a function FH () 

10 presenting quantities indicating the magnitude of the field angles of 
the imaging zone as presented by the expression 75 is selected, and 
the expression 71 is replaced by the expression 76 and the 
expressions 72 to 74 are replaced by the expressions 77 to 79 to 
further satisfy the requirements above. Needless to say, the 

15 imaging zone adjusting apparatus of the present invention allows 
the cycle Tcycle imaging zones of the camera terminals 120A to 120C 
to be adjusted so that the imaging target zone 121 is efficiently 
imaged. 

20 [0233] 



[Math 75] 




...(Formula 75) 



25 [0234] 

[Math 76] 
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Pa xFA A {6b PA ,6b rA ,6b„ Ai 6b llA ) + p a *FE A {Gb mi 6b VA )+P c xFH A (6b HA ,6b VA ) 

FY B {Bb PBS eb TB ,eb HB ,ob t ^ = 

Pa * FA B (6b PB , &b TB , Obfj B , ) + {3 B x FE a (6b HB , 6by S ) + f$ c x FH $ (6b Mg , 6b )/B ) 
FY C (6b pc , 6b TC , &b HC , 6b yc ) = 

...(Formula 76) 

[0235] 
[Math 77] 

5 



6b PA = 6b PA - a 



t 

6b TA — 0b TA - a 



„dFY\eb PA ,eb TA ,&b HA ,eb VA ) 



deb PA 



dFY A (0b PA ,9b TA ,0b M ,0bJ 



dOb TA 



a dFY A (eb PA ,eb TA ,eb HA ,eb VA ) 



d6b HA 



9b VA = 6b VA - a 



dFY A (6b PA ,9b TA ,0b HA ,0b M ) 
39b 



...(Formula 77) 



[0236] 
[Math 78] 

10 
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Ob PB = 8b PB — a 



^dFY B {eb PB ,ob TB ^b HBi eb VB ) 



dOb 



8b m — 8b TB — cc 



d0b 



0b' m = 0b m - a 



dFY B {0b PB ,0b TB ,0b HB ,ebJ 



d6b 



6b m -6byg - a 



dFY B [0b PB ,db w ,0b NB ,0bJ 



dOb 



VB 



...(Formula 78) 

[0237] 
[Math 79] 

5 



eb PC 


= 6b PC 


— a 


8FY C 


\6b pc , eb TC , 0b HC , 0b vc ) 




86b pc 


6b TC 


= 9b rc 


- a 


8FY C 


[0b PC , 0b TC , 0b HC , 6b vc ) 




debfc 




= &b HC 


-or 


SFY C 


(eb PC , 0b TC , 0b HC , 0b vc ) 




d0b HC 


eb vc 


=eb vc 


-a 


dFY c 


(0b PC ,0b TC ,eb„ c ,0b„ c ) 




30b l/c 



...(Formula 79) 
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In the embodiment, the aspect ratio of an imaging zone can 
also be expressed by the horizontal and vertical field angles for 
simplified explanation. However, if the aspect ratio of an imaging 
5 zone is the ratio of horizontal to vertical measure of an imaging zone 
as is defined, the aspect ratio of the time T imaging zone is 
expressed by the expression 80 according to the expressions 8 to 11 
explained above for the position and view point of the imaging zone 
of a camera. 



[0238] 
[Math 80] 

Magnitude of Time T Imaging Region in the Horizonal Direction 
Magnitude of the Time T Region in the Perpendicular Direction 

y — y 
Y -Y 



= FZ (R DQ , R Q , 5 R m , 7?, 0 . , . . , R 21 , M 00 , M m , M Q2 3 M^..M 22 ) 



As presented by the expression 80, the aspect ratio of the 
time T imaging zone is a function of M 0 o to M22 that indicate the 
orientation reference of a camera and rotation angles 0p, 0 T , and 
20 0R P that indicate the orientation shift from the orientation reference 
of a camera. Therefore, the aspect ratio of the cycle Tcycle imaging 
zone changes in association with the orientation reference and the 



10 




... (Formula 80) 



15 
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rotation angles or the shift therefrom, in other words, the time T 
camera panning angle 0a P/ time T camera tilting angle 0a T , and time 
T camera rolling angle ©a R that comprise adjusted by the imaging 
zone adjusting apparatus of the present invention every second. 
5 Needless to say, the imaging zone adjusting apparatus of the 

present invention can adjust the cycle T C ycle imaging zones of the 
camera terminals 120A to 120C based on accurate aspect ratios 
provided that Caspect presented by the expression 70, or the target 
value in the aspect ratio adjustment, is calculated by the expression 

10 80 using the orientation reference of the camera and the current 
time T camera panning angle ©a P , time T camera tilting angle ©a T/ 
and time T camera rolling angle 0a R in the procedure of Step 3003 
repeated by the adjusting unit C 208. Then, it is preferable that the 
target value of the aspect ratio is the aspect ratio of an imaging zone 

15 determined by the imaging zone position and camera installation 
position. 

[0239] 

(Embodiment 5) 

20 Embodiment 5 of the present invention is described hereafter. 

In the embodiment, an imaging zone adjusting apparatus in which 
the cycle T C ycle imaging zones of the cameras of the camera 
terminals are self-adjusted using a zone dividing process so that a 
combined zone of the cycle Tcycle imaging zones of the cameras of 

25 the camera terminals completely covers a specific imaging target 
zone is described with reference to FIGS. 40 to 43. 

[0240] 

First, components of the imaging zone adjusting apparatus of 
30 the embodiment are described. FIG. 40 is a block diagram showing 
the structure of the imaging zone adjusting apparatus of the 
embodiment. The imaging zone adjusting apparatus comprises 
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camera terminals 101A to 101C, an operation terminal 102, and a 
network 103. The camera terminals 101A to 101C, operation 
terminal 102, and network 103 in FIG. 40 are the same as those of 
Embodiment 1. Further, an X w -axis 110, a Y w -axis 111, a Z w -axis 
5 112, a real space plane 113, a cycle TA C ycle imaging zone 120A, a 
cycle TBcycle imaging zone 120B, a cycle TCcycle imaging zone 120C, 
and an imaging target zone 121 in FIG. 40 are the same as those of 
Embodiment 1. On the real space plane 113, the number 140A 
indicates a view point A comprising the view point of the cycle 

10 TAcycle imaging zone 120A periodically imaged by the camera 

terminal 101A in a cycle TAcycle, the number 140B indicates a view 
point B comprising the view point of the cycle TBcycle imaging zone 
120B periodically imaged by the camera terminal 101B in a cycle 
TBcycle, and the number 140C indicates a view point C comprising 

15 the view point of the cycle TCcycle imaging zone 120C periodically 
imaged by the camera terminal 101C in a cycle TCcycle- 

[0241] 

FIG. 41 (a) to (c) are illustrations showing the view points of 
20 the cycle Tcycle imaging zones on the real space plane 113 of the 
imaging zone adjusting apparatus of this embodiment shown in FIG. 
40 in detail. An X w -axis 110, a Y w -axis 111, a view point A 140A, a 
view point B 140B, a view point C 140C, and an imaging target zone 
121 in FIG. 41 (a) are the same as those in FIG. 40. The number 
25 150 indicates a line AB comprising a perpendicular bisector of the 
line connecting the view points A 140A and B 140B. The number 

151 indicates a line BC comprising a perpendicular bisector of the 
line connecting the view points B 140B and C 140C. The number 

152 indicates a line AC comprising a perpendicular bisector of the 
30 line connecting the view points A 140A and C 140C. The number 

150A indicates a zone A comprising a zone obtained by dividing the 
imaging target zone 121 by the lines AB 150 and AC 152. The 
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number 150B indicates a zone B comprising a zone obtained by 
dividing the imaging target zone 121 by the lines AB 150 and BC 151. 
The number 150C indicates a zone C comprising a zone obtained by 
dividing the imaging target zone 121 by the lines BC 151 and AC 
5 152. 

[0242] 

FIG. 42 is a block diagram showing the structure of the 
camera terminals 101A to 101C in FIG. 26 (a). The camera 

10 terminals 101A to 101C each comprise at least a camera 201, an 
adjusting unit B 206, a communications unit 203, and a cycle field 
angle adjusting unit C 207. The camera 201 comprises a lens 211, 
an image pickup surface 212, an image processor 213, an 
orientation controller 214, and a cycle imaging controller 215. The 

15 camera 201, communications unit 203, lens 211, image pickup 
surface 212, image processor 213, orientation controller 214, and 
cycle imaging controller 215 in FIG. 42 are the same as those in the 
block diagram showing the structure of the camera terminals 101A 
to 101C of Embodiment 1 shown in FIG. 27. In the block diagram 

20 showing the structure of the camera terminals 101A to 101C of the 
embodiment shown in FIG. 42, the adjusting unit A 202 of the 
Embodiment 1 is replaced by the adjusting unit B 206, the cycle 
Tcycle camera horizontal and vertical field angles 0b H and 0b v are 
not fixed values, and the cycle field angle adjusting unit C 207 

25 comprising a processor to adjust and output the field angles of the 
cycle Tcycle imaging zone of the camera 201 is added. The 
operation terminal 102 has the same structure as that of FIG. 28. 

[0243] 

30 Operation of the imaging zone adjusting apparatus of the 

embodiment is described hereafter. The adjusting unit B 206 
periodically sends view point position information of the cycle Tcycle 
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imaging zone of the camera 201 sent from the cycle imaging 
controller 215 to the adjusting unit B 206 of the other camera 
terminals via the communications unit 203 and network. Further, 
the adjusting unit B 206 receives the view point position information 
5 of the cycle T C ycle imaging zone of the camera 201 of the other 
camera terminals periodically sent from the adjusting unit B 206 of 
the other camera terminals. In addition, the communications unit 
203 of the operation terminal 102 periodically sends positional 
information of the imaging target zone 121 to the adjusting unit B 
10 206 of the camera terminals 101A to 101C via the network 103. 

[0244] 

Therefore, with the camera terminals 101A to 101C, the 
adjusting unit B 206 periodically receives the view point position 

15 information of the cycle T C ycle imaging zone of the camera 201 of 
one's own camera terminal and other camera terminals and the 
positional information of the imaging target zone 121. In the 
embodiment, each adjusting unit B 206 periodically receives the 
position of the view point 140A comprising the view point of the 

20 cycle TAcycle imaging zone 120A of the camera terminal 101A, the 
position of the view point 140B comprising the view point of the 
cycle TBcycle imaging zone 120B of the camera terminal 101B, the 
position of the view point 140C comprising the view point of the 
cycle TCcycle imaging zone 120C of the camera terminal 101C, and 

25 Xjl 131TL, X TR 131TR, Y TU 131TU, and Y TB 131TB comprising the 
position of the imaging target zone 121 via the communications unit 
203 and network 103. 

[0245] 

30 Further, the adjusting unit B 206 performs the procedures of 

the steps below and shown in FIG. 43 based on the obtained view 
point positions of the cycle T C ycle imaging zones and the obtained 
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positional information of the imaging target zone 121. 
[0246] 

First, in Step 1301, the imaging target zone 121 is divided 
5 based on the view point position information of the cycle Tcycle 
imaging zones of the cameras 201 of one's own camera terminal and 
other camera terminals and the positional information of the 
imaging target zone 121. The dividing process is already described 
(zone dividing) and not explained here. As a result of the diving 

10 process, the imaging target zone 121 is divided into the zone A 150A 
assigned to the camera terminal 101A, zone B 150B assigned to the 
camera terminal 101B, and zone C 150C assigned to the camera 
terminal 101C as shown in FIG. 41 (a) to (c). Then, in Step 1302, 
the adjusting unit B 206 of the camera terminal 101A adjusts the 

15 cycle Tcycle camera panning and tilting angles to make the distances 
from the view point A 140A to the boundaries of the zone A 150A 
assigned to the camera terminal (L A i to A A 4 in FIG. 41 (a)) equal, the 
adjusting unit B 206 of the camera terminal 101B adjusts the cycle 
Tcycle camera panning and tilting angles to make the distances from 

20 the view point B 140B to the boundaries of the zone B 150B assigned 
to the camera terminal (L B i to A B 4 in FIG. 41 (b)) equal, and the 
adjusting unit B 206 of the camera terminal 101C adjusts the cycle 
Tcycle camera panning and tilting angles to make the distances from 
the view point C 140C to the boundaries of the zone C 150C assigned 

25 to the camera terminal (L C i to Acs in FIG. 41 (c)) equal. 

[0247] 

The adjusting process is described below. First, a function 
FK () that has the minimum value when the distances to the 
30 boundaries are equal is selected. In the embodiment, the function 
is presented by the expression 81. The expressions of the 
expression 81 correspond to the camera terminals 101A to 101C, 
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respectively, yielding the sum of the values obtained by raising the 
difference between the distance to each boundary and the average 
of the distances to the boundaries to the second power and having 
the minimum value when the distances to the boundaries are equal. 

[0248] 
[Math 81] 
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Then, the generally known steepest descent method is used 
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as presented by the expression 82 to calculate the next cycle Tcycle 
camera panning and tilting angles of one's own camera terminal. In 
the expression 82, ©b PA and 0d T a, ©b PB and ©b TB/ and ©b PC and ©b T c 
comprise the cycle Tcycle camera panning and tilting angles of the 
5 camera terminals 101A to 101C, respectively, ©b' P A and © b 'ta , 0b' PB 
and ©b' T B/ and ©b' PC and 0b' T c comprise the next cycle Tcycle camera 
panning and tilting angles of the camera terminals 101A to 101C, 
respectively, and a is a constant (functions G A i (),G B i (), and G c i () 
are functions to calculate the distances from the view points A 140A, 
10 B 140B, and C 140C to the respective boundaries determined by 
0b PA and @b T A, ©b PB and 0b TB , and ©b PC and ©b T c, respectively). 

[0249] 
[Math 82] 

15 
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Finally, the cycle T C ycle camera panning and tilting angles of 
the camera terminals 101A to 101C are adjusted for the next cycle 
Tcycle camera panning and tilting angles of one's own camera 
5 terminal. 

[0250] 

The adjusting unit B 206 performs the procedures of Steps 
1301 and 1302 in sequence and returns to the procedure of Step 

10 1301 after completing the procedure of Step 1302. Constantly 
repeating the procedures of Steps 1301 to 1303, the adjusting unit 
B 206 sends the cycle Tcycle camera panning and tilting angles 
calculated by the expressions above to the cycle imaging controller 
215 so that the view point position of the cycle Tcycle imaging zone 

15 of the camera 201 is adjusted. 

[0251] 

The operation of the adjusting unit B 206 is as described 
above. In Step 1302, the cycle Tcycle camera panning and tilting 

20 angles of one's own camera terminal are calculated by the steepest 
descent method in which the distances to the boundaries become 
equal and adjusted for the next cycle Tcycle camera panning and 
tilting angles, thereby adjusting the view point position of the cycle 
Tcycle imaging zone of the camera 201. Therefore, with the 

25 procedures of Steps 1301 to 1302 being repeated, the distances to 
the boundaries L A i to L A 4, L B i to L B 4, and L C i to L C s in FIG. 41 (a) to 
(c) are made equal, respectively. When the distances to the 
boundaries are equal in FIG. 41 (a) to (c), the zones A 140A, B 140B, 
and C 140C are equal in size. 

30 

[0252] 

The cycle field angle adjusting unit C 207 adjusts the 
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horizontal and vertical field angles 0b H and 0b v of the cycle Tcycle 
imaging zone of the camera 201 each time the adjusting unit B 206 
completes the zone dividing procedure of Step 1301 so that the zone 
divided by the zone dividing process and assigned to one's own 
5 camera terminal is covered. In the embodiment, the horizontal and 
vertical field angles ©b H A and 0b V A of the cycle TA C ycle imaging zone 
120A are adjusted so that the camera terminal 101A covers the zone 
A 140A assigned thereto; the horizontal and vertical field angles 
0b H B and 0b V B of the cycle TBcycle imaging zone 120B are adjusted 

10 so that the camera terminal 101B covers the zone B 140B assigned 
thereto; and the horizontal and vertical field angles 0b H c and 0bvc of 
the cycle TCcycle imaging zone 120C are adjusted so that the camera 
terminal 101C covers the zone C 140C assigned thereto. The zone 
positions are calculated in the zone dividing procedure of Step 1301; 

15 therefore, the horizontal and vertical field angles 0b H and ©b v are 
easily calculated from the zone positions in the adjustment. 

[0253] 

The operation of the imaging zone adjusting apparatus of the 
20 embodiment is as described above. The imaging target zone 121 is 
divided into zones by the adjusting unit B 206 In Step 1301 and the 
field angles of the cycle T C ycle imaging zones of the camera 
terminals are adjusted by the cycle field angle adjusting unit C 207 
so that the divided zones are covered, whereby the imaging zone 
25 adjusting apparatus of the present invention allows the camera 

terminals 101A to 101C to image the imaging target zone 121 with 
no blind spots. 

[0254] 

30 The adjusting unit B206 adjusts the cycle Tcycle camera 

panning and tilting angles so that the distances to the boundaries of 
a zone become equal and, therefore, the zones are nearly equal in 



- 152- 



size In Step 1302. The procedure serves to prevent a divided zone 
from being too large to adjust the field angles of the cycle T C ycle 
imaging zone so that the camera terminal assigned thereto covers 
the zone. The procedure is unnecessary where no divided zones 
5 can be excessively large. For example, when the camera terminals 
are installed in the manner that the view point positions of the cycle 
Tcycle imaging zones of the camera terminals are equally spaced 
from each other within the imaging target zone 121, no divided 
zones can be excessively large and the procedure of Step 1302 is 
10 unnecessary. 

[0255] 

The effect that the imaging target zone 121 is imaged with no 
blind spots is obtained by the adjusting unit B 206 repeating the 

15 procedures of Step 1301 to 1302 and the cycle field angle adjusting 
unit C 207 adjusting the field angles of the cycle Tcycle imaging 
zones each time the dividing procedure of Step 1301 is completed so 
that the zone assigned to one's own camera terminal is covered. 
The procedure of Step 1302 and the procedure performed by the 

20 cycle field angle adjusting unit C 207 are repeated for the zone 

divided based on the sight line positions of the camera terminals and 
the position of the imaging target zone 121 and assigned to one's 
own camera terminal. 

25 [0256] 

Therefore, even if any change occurs in the sight line 
positions of the camera terminals and the position of the imaging 
target zone 121 at each time point, the effect that the imaging 
target zone 121 is imaged with no blind spots can be obtained in 
30 accordance with the change. The sight line positions of the camera 
terminals and the position of the imaging target zone 121 may be 
changed when: 
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(1) the sight line position of the cycle Tcycle imaging zone of a 
camera terminal is intentionally changed; 

(2) an additional camera terminal is installed; 

5 (3) some of the camera terminals are removed or unserviceable; or 
(4) the imaging target zone position sent from the operation 
terminal is changed. 



The operation of the present invention in response to these 
10 situational changes is described in Embodiments 6 and 7, described 
later. Even if the view point positions of the cycle Tcycle imaging 
zones sent from the camera terminals or the imaging target zone 
position sent from the operation terminal is changed or not sent, or 
the view point position of a new cycle Tcycle imaging zone is sent 
15 according to these changes, the imaging zone adjusting apparatus 
of the present invention allows the camera terminals to image the 
imaging target zone with no blind spots, in accordance with changes 
in the view point positions of the cycle T C ycle imaging zones or the 
position of the imaging target zone. 

20 

[0257] 

In the embodiment, as shown in FIG. 40, the adjusting unit B 
206 and field angle adjusting unit C 207 are distributed at each 
camera terminal 101A to 101C. Needless to say, the same effect 
25 can be obtained where one each of the adjusting unit B 206 and 
angle adjusting unit C 207 is present and the only one each of the 
adjusting unit B 206 and field angle adjusting unit C 207 controls the 
view point position and field angles of the cycle T C ycle imaging zone 
of the camera 201 of the camera terminals 101A to 101C. 

30 

[0258] 
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In the embodiment, the network 103 is a network line used 
for general communication. Needless to say, the same effect can 
be obtained regardless of that the network 103 is a wired or wireless 
network. 

5 

[0259] 

(Embodiment 6) 

Embodiment 6 of the present invention is described hereafter. 
In the embodiment, the operation terminal 102 of the imaging zone 
10 adjusting apparatus of the present invention described in 
Embodiments 1 to 5 of the present invention is additionally 
described with reference to several modified embodiments. 

[0260] 

15 In Embodiments 1 to 5, the operation terminal 102 having the 

structure shown in FIG. 28 sends the positional information of the 
imaging target zone 121 to the camera terminals 101A to 101C in 
FIG. 26 or 40 from the communications unit 203. The operation 
terminal 102 is required for the operation and structure of the 

20 camera terminals 101A to 101C described in Embodiments 1 to 5. 
However, the operation terminal 102 is not particularly necessary 
where the positional information of the imaging target zone is preset 
in the camera terminals 101A to 101C. 

25 [0261] 

The operation terminal 102 contains the communications unit 
203 as a component. The communications unit 203 is also provided 
to camera terminals 101A to 101C. If the communications unit 203 
of the camera terminals 101A to 101C sends the positional 
30 information of the imaging target zone 121, the camera terminals 
101A to 101C also serve as the operation terminal 203, in which 
case the operation terminal 102 is not particularly necessary. 
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[0262] 

Further, in Embodiments 1 to 5, the operation terminal 102 
sends the positional information of the imaging target zone 121. 
The positional information of the imaging target zone 121 is the 
5 positional information of the ends of the imaging target zone 121. 
One operations terminal 102 is used in Embodiments 1 to 5. 
Needless to say, the same effect of the imaging zone adjusting 
apparatus of the present invention can be obtained using N 
operation terminals 102 to send the positional information of each 
10 end of the imaging target zone 121 and to define a closed zone 
constituted by the end positions as the imaging target zone 121 
where the imaging target zone 121 has N ends. 

[0263] 

Further, the positional information of the imaging target zone 
121 sent from the operation terminal 102 is a predetermined fixed 
value in Embodiments 1 to 5, according to which, even if the position 
of the imaging target zone 121 sent from the operation terminals 
102 is changed, the imaging zone adjusting apparatus of the present 
invention can have the effect that the imaging target zone 121 is 
imaged with no blind spots in accordance with the change. 
Therefore, the positional information of the imaging target zone 121 
sent from the operation terminal 102 can be chronologically 
changed while the imaging zone adjusting apparatus of the present 
invention is in operation. 

[0264] 

The operation terminal 102 is additionally described above. 
Exemplary operation of the imaging zone adjusting apparatus of the 
30 present invention including the above additional explanation is 

described with reference to FIG. 44. In FIG. 44, camera terminals 
1401 comprise the camera terminals in Embodiments 1 to 5 and 
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25 



communicate with the other camera terminals 1401 and an 
operation terminal 1405 via a wireless network 1402. A vehicle 
1403 runs on a road 1404 and is provided with the operation 
terminal 1405. An imaging target zone A 1406A and an imaging 
5 target zone B 1406B comprise the cycle T C ycle imaging zones of the 
vehicle 1403 running on the road 1404 at each time point. The 
imaging target zone is a zone having a specific size around the 
position of the vehicle 1403 and obtained by GPS or gyro-compass, 
being sent from the operation terminal 1405. 

10 

[0265] 

The operation is as follows. The multiple camera terminals 
1401 of the imaging zone adjusting apparatus of the present 
invention installed over the road 1404 communicate with the other 
15 camera terminals via the wireless network 1402. The operation 
terminal 1405 installed in the vehicle 1403 running on the road 1404 
sends the positional information of the imaging target zone around 
the current position the vehicle 1403 to the camera terminals 1401 
via the wireless network 1402. 

20 

[0266] 

With the imaging zone adjusting apparatus having the 
structure above, the imaging target zone around the position of the 
vehicle 1403 that chronologically changes can be imaged with no 
25 blind spots. Image information obtained with no blind spots is 

provided to the driver of the vehicle 1403 via the wireless network 
1402. The driver of the vehicle 1403 can obtains information on the 
surroundings with no blind spots, supporting safe driving and 
parking. 

30 

[0267] 

(Embodiment 7) 
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Embodiment 7 of the present invention is described hereafter. 
In the embodiment, the process to specify the cycle Tcycle imaging 
zone position of the camera terminals of the imaging zone adjusting 
apparatus of the present invention described in Embodiments 1 to 5 
5 is additionally described with reference to several modified 
embodiments. 

[0268] 

In Embodiments 1 to 5, the adjusting unit A 202, cycle field 

io angle adjusting unit A 204, cycle field angle adjusting unit B 205, 
adjusting unit B 206, or adjusting unit C 208 of the camera terminals 
101A to 101C in FIG. 26 or 40 operates based on the flowcharts 
shown in FIGS. 29, 33, 35, 39, and 43, respectively. In the 
embodiment, the adjusting unit A 202 of the camera terminals 

15 operating based on the flowchart shown in FIG. 29 operates based 
on FIG. 45, the cycle field angle adjusting unit A 204 of the camera 
terminals operating based on the flowchart shown in FIG. 33 
operates based on the flowchart shown in FIG. 37, the cycle field 
angle adjusting unit B 205 of the camera terminals operating based 

20 on the flowchart shown in FIG. 35 operates based on the flowchart 
shown in FIG. 47, the adjusting unit C 208 of the camera terminals 
operating based on the flowchart shown in FIG. 39 operates based 
on the flowchart shown in FIG. 48, and the adjusting unit B 206 of 
the camera terminals operating based on the flowchart shown in FIG. 

25 43 operates based on the flowchart shown in FIG. 49. 

[0269] 

The flowchart shown in FIG. 45 is the flowchart shown in FIG. 
29 and described in Embodiment 1 with the addition of Steps 1504 
30 and 1505. Needless to say, the effect of the imaging zone adjusting 
apparatus of the present invention can be obtained since the 
procedures of Steps 1501 to 1503 are repeated as in Embodiment 1 
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when No is selected, or the position of a cycle T C ycle imaging zone is 
not specified, in Step 1504. 

[0270] 

5 The flowchart shown FIG. 46 is the flowchart shown in FIG. 33 

and described in Embodiment 2 with the addition of Steps 1604 and 
1605. Needless to say, the effect of the imaging zone adjusting 
apparatus of the present invention can be obtained since the 
procedures of Steps 1601 to 1603 are repeated as in Embodiment 2 
10 when No is selected, or the field angles of a cycle T C ycle imaging zone 
are not specified, in Step 1604. 

[0271] 

The flowchart shown in FIG. 47 is the flowchart shown in FIG. 

15 35 and described in Embodiment 3 with the addition of Steps 1706 
and 1707. Needless to say, the effect of the imaging zone adjusting 
apparatus of the present invention can be obtained since the 
procedures of Steps 1701 to 1705 are repeated as in Embodiment 3 
when No is selected, or the field angles of a cycle T C ycle imaging zone 

20 are not specified, in Step 1706. 

[0272] 

The flowchart shown in FIG. 48 is the flowchart shown in FIG. 
39 and described in Embodiment 4 with the addition of Steps 4004 
25 and 4005. Needless to say, the effect of the imaging zone adjusting 
apparatus of the present invention can be obtained since the 
procedures of Steps 4001 to 4003 are repeated as in Embodiment 4 
when No is selected, or the field angles of a cycle Tcycle imaging zone 
are not specified, in Step 1904. 

30 

[0273] 

The flowchart shown in FIG. 49 is the flowchart shown in FIG. 
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43 and described in Embodiment 5 with the addition of Steps 1803 
and 1804. Needless to say, the effect of the imaging zone adjusting 
apparatus of the present invention can be obtained since the 
procedures of Steps 1801 to 1802 are repeated as in Embodiment 4 
5 when No is selected, or the cycle T C ycle camera panning or tilting 
angle is not specified, in Step 1803. 

[0274] 

In the flowcharts shown in FIGS. 45 to 49, when Yes is 
10 selected, or the position or field angles of a cycle T C ycle imaging zone 
or the cycle T C ycle camera panning or tilting angle is specified, in 
Step 1504, 1604, 1706, 1803, or 4004, then, in Step 1505, 1605, 
1707, 1804, or 4005, the position or field angles of the cycle Tcycle 
imaging zone or the cycle Tcycle camera panning or tilting angle of 
15 the camera terminal is adjusted for the cycle Tcycle imaging zone 
position or field angles or cycle Tcycle camera panning or tilting 
angle specified In Step 1504, 1604, 1706, 1803, or 4004. 

[0275] 

20 The position or field angles of a cycle Tcycle imaging zone or 

the cycle Tcycle camera panning or tilting angle specified In Step 
1504, 1604, 1706, 1803, or 4004 is manually specified via the 
network 103. Alternatively, they are detected by the image 
processor 213 in FIG. 27 using a conventional image processing 

25 such as pattern matching of the position and size of a detection 
target based on images captured by the camera terminals. Then, 
the cycle Tctcle imaging zone position or field angles or cycle T C tcle 
camera panning or tilting angle that allows the cycle Tctcle imaging 
zone to have the detected detection target at the center and contain 

30 the entire detection target is specified. 
[0276] 

As described above, through the operation of the camera 
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terminals based on the flowcharts shown in FIGS. 45 to 49, when the 
position or field angles of a cycle T C tcle imaging zone or the cycle 
Tcycle camera panning or tilting angle is specified or as for a camera 
terminal to which these are specified, the position or field angles of 
5 the cycle T C tcle imaging zone or the cycle T C tcle camera panning or 
tilting angle is adjusted. When the position or field angles of a 
cycle Tctcle imaging zone or the cycle Tcycle camera panning or 
tilting angle is not specified or as for a camera terminal to which 
these are not specified, the camera terminal images the imaging 

10 target zone with no blind spots as in Embodiments 1 to 5. 

The process to specify the position and the like of a cycle Tcycle 
imaging zone of a camera terminal is additionally described above. 
Exemplary operation of the imaging zone adjusting apparatus of the 
present invention including the above additional explanation is 

15 described with reference to FIGS. 50 and 51. 

[0277] 

In FIG. 50 (a) and (b), camera terminals 1901A to 1901E 
comprise the camera terminals in Embodiments 1 to 5 and operate 
20 based on the flowcharts shown in FIGS. 45 to 49. A network 1902 
is a network transferring information among the camera terminals 
1901A to 1901E. A detection target 1903 is a detection target to be 
detected by the camera terminals 1901A to 1901E and present 
within an imaging target zone 1904. 

25 

[0278] 

The operation is as follows. The camera terminals 1901A to 
1901E operate based on the flowcharts shown in FIGS. 45 to 49. 
The camera terminal 1901B detects the detection target 1903; 
30 therefore, the position or field angles of the cycle Tcycle imaging 
zone or the cycle T C ycle camera panning or tilting angle is specified 
In Step 1504, 1604, 1706, 1803, or 4004. The specified cycle 
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Tcycle imaging zone position or field angles or cycle T C ycle camera 
panning or tilting angle is a position or field angles of the cycle Tcycle 
imaging zone or a cycle Tcycle camera panning or tilting angle that 
allows the cycle Tcycle imaging zone to have the detection target 
5 1903 at the center and contain the entire detection target 1903. 
Consequently, the camera terminal 1901B is adjusted for a cycle 
Tcycle imaging zone position or field angles or a cycle T C ycle camera 
panning or tilting angle that allows the cycle Tcycle imaging zone to 
have the detection target 1903 at the center and contain the entire 
10 detection target 1903. The camera terminals 1901A, 1901C, 
1901D, and 1901E do not detect the detection target 1903 and, 
therefore, are adjusted to image the imaging target zone 1904 with 
no blind spots as in Embodiments 1 to 5. 

15 [0279] 

With the operation of the camera terminals 1901A to 1901E 
described above, when the detection target 1903 is present in the 
imaging target zone 1904, an detailed image of the cycle Tcycle 
imaging zone having the detection target 1903 at the center and 
20 containing the entire detection target 1903 is obtained and the 

imaging target zone is imaged with no blind spots. Needless to say, 
even if the detection target 1903 moves, the same operation is 
performed with the camera terminal to detect the detection target 
1903 being switched. 

25 

[0280] 

In FIG. 50 (a) and (b), the camera terminal 1901B detects the 
detection target 1903 and a detailed image of the cycle Tcycle 
imaging zone having the detection target 1903 at the center and 
30 containing the entire detection target 1903 is obtained. If the 

camera terminal 1901B continues to send the positional information 
of one's own cycle Tcycle imaging zone via the network, the camera 
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terminals 1901A and 1901C image the imaging target zone 1904 
with no blind spots in cooperation with the camera terminal 1901B 
because they recognize the cycle T C ycle imaging zone imaged by the 
camera terminal 1901B as an adjacent cycle T C ycle imaging zone as 
5 shown in FIG. 50 (a). If the camera terminal 1901B discontinues 
sending the positional information of one's own cycle Tcycle imaging 
zone via the network, the camera terminals 1901A and 1901C image 
the imaging target zone 1904 with no blind spots without the camera 
terminal 1901B because they do not recognize the cycle Tcycle 
io imaging zone imaged by the camera terminal 1901B as an adjacent 
cycle Tcycle imaging zone as shown in FIG. 50 (b). 

[0281] 

As shown in FIG. 50 (a), when cooperating with the camera 
15 terminal 1901B that detects and follows the detection target 1903, 
the cycle Tcycle imaging zones of the camera terminals 1901A, 
1901C, 1901D, and 1901E are significantly influenced by the 
movement of the cycle Tcycle imaging zone of the camera terminal B, 
or the motion of the detection target 1903, and, consequently, 
20 images of the cycle Tcycle imaging zones may be disrupted. The 
problem can be resolved, for example, by allowing the camera 
terminal imaging the detection target to discontinue sending the 
positional information of one's own cycle Tcycle imaging zone via the 
network 1902 when the detection target 1903 is in vigorous motion. 

25 

[0282] 

In FIG. 51, camera terminals 2001A to 2001C comprise the 
camera terminals in Embodiments 1 to 5 and operate based on the 
flowcharts shown in FIGS. 45 to 49. A network 2002 is a network 
30 transferring information among the camera terminals 2001A to 

2001C. A detection target 2003 is an object to be detected by the 
camera terminals 2001A to 2001C and present within an imaging 
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target zone 2004. These elements are the same as those in FIG. 50. 
With this structure, the camera terminals 2001A to 2001C 
automatically obtain an image of a cycle T C ycle imaging zone having 
the detection target 2003 at the center and containing the entire 
detection target 2003 and detect the imaging target zone 2004 with 
no blind spots when the detection target 2003 is present in the 
imaging target zone 2004. In FIG. 51, the following units are 
added to the imaging zone adjusting apparatus of the present 
invention shown in FIG. 50. An image merging unit 2005 is a 
processor to merge images obtained by the camera terminals 2001A 
to 2001C in an imaging cycle T C ycle into a spatially continued single 
image. A display 2006 is an LCD and the like to display the image 
merged by the image merging unit 2005. An instruction unit 2007 
is a keyboard and the like to specify the position or field angles of a 
cycle Tcycle imaging zone or the cycle Tcycle camera panning or 
tilting angle to the camera terminals 2001A to 2001C. 

[0283] 

The operation is as follows. The image merging unit 2005 
20 receives images captured by the camera terminals 2001A to 2001C 
and information including the positions of the cycle Tcycle imaging 
zones sent from the camera terminals 2001A to 2001C via the 
network 2002. The image merging mart 2005 merges the images 
captured by the camera terminals into an image in which the images 
25 are arranged in the order of their spatial positions as shown in FIG. 
52 based on the information including the positions of the cycle 
Tcycle imaging zones of the camera terminals. The merged image is 
displayed on the display 2006 and the image information is 
presented to the user. Images obtained by the camera terminals 
30 2001A to 2001C and the positions on the world coordinates system 
of the pixels constituting the images, used for merging by the image 
merging unit 2005, can be calculated by Math 8 and the image 

- 164- 



10 



merging unit 2005 can merge images into an image in which the 
various view points are arranged in the order of their spatial 
positions using a conventional projection conversion technique. 

5 [0284] 

Those who observe the merged image displayed on the 
display 2006 makes input to the instruction unit 2007 on the 
position or field angles of a zone on the merged image that he/she 
wants. For the input, a pointing device and the like is used to 

10 specify the position or field angles of the zone. Receiving the 
position or field angles of the individually specified zone, the 
instruction unit 2007 identifies the camera terminal having the zone 
within its current cycle T C ycle imaging zone. This identification can 
be done using information including the position of the cycle T C ycle 

15 imaging zone sent from the camera terminals 2001A to 2001C. The 
instruction unit 2007 instructs the camera terminal having within its 
cycle Tcycle imaging zone the individually specified zone and 
identified to have the individually specified position or field angles 
as the position or field angles of the cycle Tcycle imaging zone of the 

20 camera terminal via the network 2002. The camera terminal to 
which the position or field angles of the cycle Tcycle imaging zone are 
specified adjusts the position or field angles of the cycle Tcycle 
imaging zone of that camera terminal for the specified position or 
field angles of the cycle Tcycle imaging zone. 

25 

[0285] 

With the above operation, users can receive image 
information of the imaging target zone 2004 with no blind spots and 
various view points and in the order of their spatial positions. 
30 Further, by specifying the position or field angles of the zone 

specified based on the image information, an image at a particular 
zone position or field angle can be obtained. For example, if 
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manual input is made to the instruction unit 2007 to make the field 
angles of a zone smaller, an image of the zone with higher field 
angles or resolutions and imaging frequency F is displayed on the 
display 2006. The effect is beneficial for surveillance of buildings 
5 having an extensive imaging target zone. 

[0286] 

(Embodiment 8) 

Embodiment 8 of the present invention is described hereafter. 
io In the embodiment, the imaging zone adjusting apparatus of the 
present invention described in Embodiments 1 to 5 is additionally 
described with reference to several modified embodiments. 

[0287] 

15 In the imaging zone adjusting apparatus of the present 

invention described in Embodiments 1 to 5, the camera terminal 
shown in FIG. 27, 32, 34, 38, or 42 has variable parameters 
including the position or field angles of the cycle T C ycle imaging zone, 
cycle Tcycle camera panning or tilting angle, position or field angles 

20 of the time T imaging zone, panning or tilting angle, or panning or 
tilting speed. The same effect as described in Embodiments 1 to 5 
can be obtained when some, not all, of the parameters are variable. 
Further, the same effect as described in Embodiments 1 to 5 can be 
obtained even if camera terminals of which all parameters are not 

25 variable are present among multiple camera terminals. This is 
because, even if camera terminals of which all parameters are not 
variable and the position and field angles of the cycle Tcycle imaging 
zone are not adjustable are present, camera terminals of which 
parameters are variable and the position and field angles of the 

30 cycle Tcycle imaging zone are adjustable operate as described in 
Embodiments 1 to 5, having the cycle Tcycle imaging zone as an 
adjacent cycle Tcycle imaging zone of those camera terminals. 
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Therefore, the same effect as described in Embodiments 1 to 5 can 
be obtained. 

[0288] 

5 In the imaging zone adjusting apparatus of the present 

invention described in Embodiments 1 to 5, the camera terminal 
shown in FIG. 27, 32, 34, 38, or 42 has the position or field angles 
of the cycle T C ycle imaging zone, cycle Tcycle camera panning or 
tilting angle, position or field angles of the time T imaging zone, 

10 panning or tilting angle, or panning or tilting speed adjusted by the 
orientation controller 214 using a mechanical control mechanism 
such as a stepping motor. However, it does not necessarily requires 
a mechanical control mechanism such as a stepping motor as long as 
the position or field angles of the cycle T C ycle imaging zone, cycle 

15 Tcycle camera panning or tilting angle, position or field angles of the 
time T imaging zone, panning or tilting angle, or panning or tilting 
speed is adjusted. 

[0289] 

20 For example, there is a camera of which the panning, tilting, 

and field angles are electronically controlled using a technique 
called a partial scanning shown in FIG. 53. In FIG. 53 (a), (b), and 
(c), the number 2201 indicates a lens forming an image, the number 
2202 is an image pickup surface such as a CCD capturing an image 

25 formed by the lens 2201, the number 2203 is an image acquisition 
controller acquiring an image only within an image acquisition range 
indicated by the number 2204 of the image captured by the image 
pickup surface 2202. When the image pickup surface 2202 is a CCD, 
the image acquisition controller 2203 controls the addresses of 

30 pixels to read the CCD, thereby electronically reading only the image 
within the image acquisition range 2204. Further, by changing the 
address control, the image acquisition range 2204 can be changed. 
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The technique called partial scanning electronically controls the 
panning, tilting, and field angles of a camera by changing the image 
acquisition range 2204 as shown in FIG. 53 (a), (b), and (c). 

5 [0290] 

Further, in the imaging zone adjusting apparatus of the 
present invention described in Embodiments 1 to 5, the real space 
plane 113 has Z w = 0 as shown in FIGS. 26 and 40. Needless to say, 
the same effect can be obtained as described in Embodiments 1 to 5 

10 when the real space plane 113 has Z w = C as shown in FIG. 54 (the 
components in FIG. 54 are the same as those in FIG. 26). Further, 
the cycle T C ycle imaging zones imaged by the camera terminals are 
enlarged as they move to 0 on the Z w -axis 112. Therefore, a 
three-dimensional imaging target zone can be imaged with no blind 

15 spots as is a three-dimensional imaging target zone 213 in FIG. 54. 

[0291] 

Further, in the imaging zone adjusting apparatus of the 
present invention described in Embodiments 1 to 5, the effect as 

20 described in Embodiments 1 to 5 is obtained by adjusting the 

position or field angles of the cycle Tcycle imaging zones imaged by 
the camera terminals. As described (for the imaging process of a 
cycle Tcycle imaging zone), the cycle Tcycle imaging zone is imaged 
by moving the position of a time T imaging zone at panning and 

25 tilting speeds V P and V T . When the panning and tilting speeds V P 
and V T in the imaging process of a cycle Tcycle imaging zone is 0, the 
cycle Tcycle imaging zone coincides with the time T imaging zone. 
Needless to say, the imaging zone adjusting apparatus of the 
present invention described in Embodiments 1 to 5 yields the effect 

30 described in Embodiments 1 to 5 by adjusting the position or field 
angles of the time T imaging zones imaged by the camera terminals. 
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[0292] 

Further, the camera 201 of Embodiments 1 to 5 described 
above is a conventional camera. Needless to say, the same effect 
5 can be obtained even if the camera 201 is a camera detecting visible 
light or non-visible light such as infrared and ultraviolet. Needless 
to say, the same effect can be obtained for a conventional sensor 
having an imaging zone of which the position is changeable such as 
micro-motion, pressures, temperature, barometric pressure, 
10 acoustic (microphones) sensors. Needless to say, the same effect 
can be obtained in a combined use of a conventional camera and the 
sensors. 

[0293] 

15 For example, as for a directional microphone as shown in FIG. 

55 (a), a sensing zone can be defined as a direction (zone) in which 
sound is detected at a specific sensitivity or higher as shown in FIG. 
55 (b). Therefore, the orientation of the microphone is controlled 
in the similar manner to the panning and tilting of a camera in the 

20 embodiments described above for scanning in a specific cycle. 

Thus, the cycle Tcycle detection zone (in other words, "a hypothetical 
detection zone") corresponding to the cycle T C ycle imaging zone for 
a camera terminal can be defined as shown in FIG. 55 (c). Hence, 
the present invention can be applied not only to cameras but also to 

25 various sensors. As shown in FIG. 55 (b) and (c), when the sensing 
zone corresponding to the time T imaging zone and the cycle Tcycle 
detection zone corresponding to the cycle Tcycle imaging zone are, 
for example, circular, not rectangular, the aspect ratio can be 
defined as the ratio of major axis to minor axis of a circle (1 for a 

30 complete round) or the ratio of measure in the X w -axis direction to 
measure in the Y w -axis of a figure. 
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[0294] 

Further, the cameras in the embodiments described above are 
fixed cameras; however, they may also be movable cameras. FIG. 
56 is a block diagram showing the structure of a surveillance system 
5 in which the imaging zone adjusting apparatus according to the 
present invention is applied to a surveillance system comprising 
movable cameras. The surveillance system comprises multiple 
movable cameras 1101 connected to a communications network 
1103, characterized by the fact that the multiple movable cameras 

10 1101 voluntarily and cooperatively move in addition to panning and 
tilting so that a surveillance zone 1111 is completely surveyed. The 
movable cameras 1101 are a camera apparatus supported and 
moved by a moving unit 1102. The moving unit 1102 is a 
mechanism to change the imaging position of the movable camera 

15 1101. The communications network 1103 is a transmission path 
connecting the multiple movable cameras 1101. A communications 
unit 1104 is a communication interface for the movable cameras 
1101 to exchange information with the other cameras via the 
communications network 1103. An adjacent imaging zone 

20 identifying unit 1105 is a processor to deduce which movable 

camera has an adjacent imaging zone based on information from the 
other cameras informed to the communications unit 1104. 

An imaging element 1106 is a CCD camera and the like which 
captures images in the surveillance zone. An imaging zone 

25 deduction component 1107 is a processor to deduce the imaging 
zone of the movable camera 1101 from the characteristics of the 
imaging element 1106 and the position of the movable unit 1102. 

Surveillance range memory 1108 is memory in which to store 
the range of a zone to be surveyed by the movable camera 1101. 

30 An imaging position evaluation unit 1109 is a processor to evaluate 
the overlapping zone where the imaging zone of the movable camera 
1101 and an adjacent imaging zone overlap or the distances to the 
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boundaries of the surveillance zone. An imaging position changer 

1110 is a controller to control the moving unit 1102 and change the 
imaging position of the movable camera 1101. A surveillance zone 

1111 is a zone to be surveyed by the movable cameras 1101. An 
5 imaging zone 1112 is a zone imaged by a movable camera 1101. 

With the surveillance system described above, the movable 
camera 1101 exchanges information regarding the imaging zones 
deduced based on the position of one's own imaging zone and the 
characteristics of the imaging element 1106 with the neighboring 

io movable cameras and change the panning, tilting, and imaging 
position in cooperation with the neighboring movable cameras so 
that the magnitude of the overlapping zone with the adjacent 
imaging zone and the distances to the boundaries of the surveillance 
zone converge on specific states, whereby the movable cameras 

15 1101 can move to imaging positions where the multiple movable 
cameras 1101 concurrently image the surveillance zone with no 
blind spots. 

[0295] 

20 FIG. 57 illustrates the operation of the movable cameras 1101 

in the surveillance system. In the figure, the movable cameras 
1101 that comprise movable in the horizontal (one-dimensional) 
direction for simplified explanation are provided on the ceiling of a 
room at a fixed height to survey the floor. As shown in the top 

25 figure, the movable cameras 1101 provided at proper positions on 
the ceiling change their imaging positions so that the width C of the 
overlapping zone of the imaging zones or the distance D to the 
boundaries of the surveillance zone converges on a specific value. 
Then, as shown in the bottom figure, the movable cameras 1101 can 

30 move to positions where the multiple movable cameras concurrently 
image the entire surveillance zone. Further, the movable cameras 
1101 can be installed at one place all together where the installation 
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is difficult such as a high ceiling. Then, the movable cameras move 
to positions where the multiple movable cameras concurrently 
image the entire surveillance zone with no blind spots. Therefore, 
the workload for deciding where movable cameras are installed or 
5 for installing them can be reduced. In an embodiment, the system 
can be constituted by installing in the surveillance zone rails on 
which the movable cameras move as shown in FIG. 58. 

[0296] 

io The camera terminal and imaging zone adjusting apparatus 

according to the present invention is described with reference to 
embodiments and modified embodiments. However, the present 
invention is not restricted to the embodiments and modified 
embodiments. For example, the present invention also includes 

15 embodiments in which the components of the embodiments and 
modified embodiments are used in any combination. 

[0297] 

The components in the Claims correspond to the components 
20 of the embodiments in the Specification as follows. The 

embodiment of the camera terminal refers to camera terminals 101A 
to 101C; an embodiment of the camera refers to a camera 201; an 
embodiment of the adjusting unit refers to an adjusting unit A 202, 
a cycle field angle adjusting unit A 204, a cycle field angle adjusting 
25 unit B 205, an adjusting unit B 206, a cycle field angle adjusting unit 
C 207, and an adjusting unit C 208; an embodiment of the 
communication unit refers to communications unit 2003; an 
embodiment of the merging unit refers to image merging unit 2005; 
an embodiment of the display unit is a display 2006; and an 
30 embodiment of the sensor refers to a sensor such as the microphone 
shown in FIG. 55. 
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Industrial Applicability 

[0298] 

The imaging zone adjusting apparatus according to the 
5 present invention is useful as an apparatus to adjust the imaging 
zone of an imaging apparatus such as a camera, for example, as a 
surveillance apparatus or an imaging system comprising multiple 
cameras, particularly as an imaging system required to efficiently 
cover a specific imaging target zone with no blind spots. 
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